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Abstract 


Improved  Intelligence  Warning  in  an  Age  of  Complexity,  by  Mr.  Bryon  D.  Mushrush,  58  pages. 

The  degree  of  complexity  and  rate  of  change  found  in  the  global  security  environment  is  increasingly 
leaving  senior  policymakers  surprised  and  US  national  interests  potentially  at  risk.  As  a  result, 
decision  makers  are  increasingly  faulting  the  Intelligence  Community  for  failure  to  provide  adequate 
warning.  A  review  of  professional  and  academic  literature  finds  intelligence  failures  are  not  the  result 
of  not  having  the  proper  information.  Instead,  it  identifies  three  primary  causes  for  intelligence 
failures.  First,  the  Intelligence  Community  structure  prevents  information  from  getting  to  the  right 
analysts  to  identify  a  threat.  Secondly,  analysts  have  the  necessary  information  but  lack  the  creativity 
to  “connect  the  dots”  to  identify  the  threat.  Finally,  analysts  may  identify  the  threat  but  fail  to 
communicate  with  sufficient  effectiveness  to  convince  policymakers  to  take  action.  This  paper 
proposes  that  complexity  theory,  and  understanding  of  the  characteristics  of  complex  adaptive 
systems  offer  insights  into  how  the  Intelligence  Community  can  address  all  three  types  of  intelligence 
failure.  It  expounds  this  proposition  by  looking  at,  and  applying  complexity  science  to  this  problem, 
which  is  represented  by  a  multidiscipline  study  of  large  networks  comprised  of  interdependent 
variables;  and  then  exploring  the  dominant  features  of  complex  systems,  namely  their  lack  of 
centralized  control,  ability  to  process  information  from  the  environment,  and  their  ability  to  develop 
novel  responses  and  adapt  to  indicate  the  sources  of  the  problem. 
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Introduction 


1  heard,  but  1  did  not  understand.  So  I  asked,  “My  Lord,  what  will  the  outcome  of  all  this 
be?  ” 


-  Daniel  12:8 


The  desire  to  receive  and  understand  warning  of  future  threats  has  been  a  part  of  all 
human  societies.  In  the  United  States,  the  task  to  warn  political  leaders  and  military  commanders 
of  threats  falls  to  the  Intelligence  Community.  Christopher  M.  Andrew,  a  professor  of  modem 
and  contemporary  history  at  Cambridge  University,  described  the  relationship  between  the 
Presidents  and  their  Intelligence  Communities  as  three  separate  ages  -  ages  of  innocence, 
transformation,  and  uncertainty.  From  President  Washington  to  the  Second  World  War  operated 
in  an  “Age  of  Innocence,”  where  the  Presidents  relied  on  the  United  States’  relative  isolation  and 
self-sufficiency  to  manage  international  affairs  and  did  not  maintain  standing  intelligence 
agencies.  The  presidencies  of  Franklin  D.  Roosevelt,  Harry  S.  Truman,  and  Dwight  D. 
Eisenhower  consist  of  the  “Age  of  Transformation”  in  which  the  United  States  created  a  standing 
Intelligence  Community  and  incorporated  it  into  the  policy  making  process.  President  Kennedy  to 
President  Clinton’s  first  term  consists  of  the  “Age  of  Uncertainty,”  where  the  Intelligence 
Community  failed  to  meet  unrealistic  expectations  and  the  pressure  of  the  Cold  War  maintained 
tensions  between  the  President  and  his  intelligence  advisors.1  This  paper  suggests  that  since  the 
end  of  the  Cold  War  the  Intelligence  Community  and  policy  makers  have  transitioned  into  an 
“Age  of  Complexity,”  where  the  rapidly  changing  and  complex  global  security  environment 
creates  new  types  of  threats  and  requires  new  understanding  of  the  environment  to  identify  the 
threats  and  address  them.  For  analysts  and  policy  makers,  complexity  science  offers  methods  to 
improve  this  understanding.  As  said  by  Ms.  Irene  Sanders,  director  of  the  Washington  Center  for 

'Roger  Z.  George  and  Robert  D.  Kline,  eds.,  Intelligence  and  the  National  Security 
Strategist:  Enduring  Issues  and  Challenges  (Lanham,  MD:  Rowman  &  Littlefield  Publishers, 
2006),  431-444. 
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Complexity  and  Public  Policy,  “We’re  all  learning  to  think  this  way.  None  of  us  have  lived  in  the 
kind  of  world  we  live  in  today. . .  we  are  all  exploring  and  we  have  new  tools  of  exploration.”2 

This  monograph  seeks  to  address  how  the  intelligence  community  can  apply  aspects  of 
the  complex  global  environment  and  complexity  science  to  improve  intelligence  warning.  The 
initial  section  describes  how  policy  makers  and  national  security  leaders  understand  the  current 
security  environment  to  being  increasingly  complex,  but  remain  frustrated  by  a  lack  of  reliable 
warning  analysis.  The  following  section  describes  how  the  academic  and  professional  literature 
on  intelligence  warning  and  failures  identifies  three  primary  sources  of  failure:  the  Intelligence 
Community’s  structure;  analyst’s  ability  to  make  sense  of  the  information  before  them;  and  lastly, 
the  policy  maker’s  ability  to  act.  After  a  brief  description  of  the  methodologies  and  limitations  in 
the  research,  this  monograph  reviews  the  transformation  of  the  Intelligence  Community  from  the 
Cold  War  to  the  present  and  how  systems  developed  in  the  Cold  War  are  no  longer  adequate  to 
address  the  increased  demands  from  policy  makers.  A  description  of  complexity  science  follows 
as  a  lens  to  describe  the  current  environment  and  how  it  can  be  applied  to  improve  the  three 
identified  causes  of  intelligence  failure.  The  last  section  briefly  discusses  additional  implications 
of  the  complex  environment  on  the  intelligence  community  and  potential  areas  of  further 
research. 

Additionally,  warning  intelligence  has  been  historically  referred  to  by  multiple  names,  to 
include  indicator  and  anticipatory  intelligence.3  For  this  paper  warning  intelligence  will  be 
defined,  as  described  in  Joint  Publication  2-0  Joint  Intelligence,  as  providing  “a  distinct 
communication  to  a  decision  maker  about  threats  against  US  security,  interests,  or  citizens. 
Warning  carries  a  sense  of  urgency,  implying  the  decision  maker  should  take  action  to  deter  or 

2Wilson  Center,  “Chaos,  Complexity,  And,  Public  Policy”  (video),  April  22,  2013, 
accessed  February  11,  2015,  https://www.youtube.com/watch?v=KXxs-JtvkkQ. 

3Cynthia  Grabo,  Handbook  of  Warning  Intelligence:  Assessing  the  Threat  to  National 
Security  (Lanham,  MD:  Scarecrow  Press,  2010),  1. 
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mitigate  the  threat’s  impact.”4  Additionally,  warning  intelligence  is  divided  into  emerging 
warning  concerns  and  enduring  warning  problems.  Emerging  warning  issues  may  be  ambiguous, 
and  may  be  formalized  as  an  “enduring  warning  problem”  based  on  a  risk  evaluation  to  national 
security  and  planning  guidance.  The  latter  is  usually  linked  to  contingency  plans,  which  are 
defined  and  longstanding  potential  threats  to  US  interests.5 

A  Complex  Global  Environment 

Chaos  was  the  law  of  nature;  Order  was  the  dream  of  man. 

-  Henry  Adams,  The  Education  of  Henry  Adams6 

Senior  American  civilian,  defense,  and  intelligence  leaders  understand  the  global  security 
environment  is  complex  and  filled  with  uncertainty.  However,  over  the  last  decade  policymakers 
and  senior  leaders  increasingly  describe  the  security  environment  as  complex,  uncertain,  rapidly 
changing,  challenging,  connected,  and  dangerous.  Understanding  the  complex  environment  is 
foundational  to  developing  national  policy  and  formulating  strategic  documents  for  the 
government.  Senior  policymakers  and  commanders  rely  on  the  Intelligence  Community  to 
provide  timely,  reliable,  and  actionable  analysis  to  provide  adequate  warning  in  support  of  policy 
decision  making.7  The  United  States  Intelligence  Community  needs  to  gain  greater  understanding 
of  complexity  in  order  to  overcome  the  structural,  cognitive,  and  communicative  challenges  to 
providing  warning  analysis. 


4Joint  Publication  (JP)  2-0,  Joint  Intelligence  (Washington,  DC:  Government  Printing 
Office,  2013),  1-18. 

5lbid. 

6Henry  Adams,  The  Education  of  Henry  Adams  (New  York:  Oxford  University  Press, 
1999),  377. 

7For  a  complete  list  of  Intelligence  Community  members,  see  Appendix  A. 
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In  2008,  then  director  of  the  Defense  Intelligence  Agency  (D1A),  Lieutenant  General 
Michael  D.  Maples,  in  Congressional  testimony  described  the  global  strategic  environment  in 
which  the  United  States  was  operating  as,  “unusually  complex. . .  marked  by  an  accelerating 
operational  pace  and  broad  spectrum  of  potential  threats.”8  Lieutenant  General  Michael  Flynn, 
Maple’s  successor  at  the  DIA,  in  a  2014  Congressional  testimony,  described  the  global  security 
environment  as  “a  growing  list  of  increasingly  complex  challenges,  conventional  adversaries,  and 
numerous  asymmetric  threats.”9  Lieutenant  General  Vincent  R.  Stewart,  the  current  DIA  director, 
testified  in  February  2015  that,  “A  confluence  of  global  political,  military,  social,  and 
technological  developments,  which,  taken  in  aggregate,  have  created  security  challenges  more 
diverse  and  complex  than  those  we  have  experienced  in  our  lifetimes. . .  This  strategic 
environment  will  be  with  us  for  some  time,  and  the  threat’s  increasing  scope,  volatility,  and 
complexity  will  be  the  ‘new  normal.’”10  In  March  2013,  Federal  Bureau  of  Investigation  director, 
Robert  S.  Mueller  III,  delivered  his  statement  entitled  “Protecting  the  Nation  in  Today’s  Complex 
Threat  Environment”  to  the  House  Appropriations  Committee,  Subcommittee  on  Commerce, 
Justice,  Science,  and  Related  Agencies.11  Prior  to  his  nomination  for  Secretary  of  Defense,  Chuck 
Hagel  stated  in  2012  that  “America  and  the  world  face  unprecedented,  complex,  and 
interconnected  twenty-first  century  challenges.”12  In  his  2013  response  to  questions  presented  by 


8Hearing  before  the  S  Committee  on  Armed  Services,  Current  and  Projected  National 
Security  Threats  to  the  United  States,  1 10th  Cong.,  2d  sess.,  2008,  S.  Doc.,  1. 

9Hearing  before  the  HR  Committee  on  Armed  Services,  Current  and  Future  Worldwide 
Threats  to  the  National  Security  of  the  United  States,  1 13th  Cong.,  2nd  Sess.,  February  11,  2014. 

10Hearing  before  the  HR  Committee  on  Armed  Services,  World  Wide  Threats,  1 1 1th 
Cong.,  1st  Sess.,  February  3,  2015. 

1 'Hearing  before  the  Subcommittee  on  Commerce,  Justice,  Science,  and  Related 
Agencies,  Protecting  the  Nation  in  Today ’s  Complex  Threat  Environment,  1 13th  Cong.,  1st  sess., 
March  19,  2013. 

12Lisa  Hymas,  “Could  Chuck  Hagel,  Defense  Secretary  Nominee,  Turn  Out  to  Be  a 
Climate  Hawk?”  grist.org,  January  7,  2013,  accessed  November  30,  2014, 
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the  senate  during  his  confirmation  hearing,  Hagel  answered  “the  next  Secretary  of  Defense  will 
be  confronted  with  a  myriad  of  challenges  stemming  from  an  ever  more  complex  global 
environment.”13 

Elected  officials,  focused  on  national  security  in  bipartisan  agreement,  also  emphasized 
the  complexity  facing  the  United  States  in  the  global  environment.  During  2014  testimony  on 
current  and  future  worldwide  threats  to  the  national  security  of  the  United  States  the  Senate 
Aimed  Serves  Committee  Chairman,  Senator  Carl  Levine  (Democrat  -  Michigan),  said  the 
United  States  finds  itself  in  “a  time  of  diverse  and  complex  national  security  threats”14  During  the 
same  hearing  Senator  James  Inhofe  (Republican  -  Oklahoma),  the  ranking  committee  member 
said  “. . .  talking  with  troops,  the  diplomats,  the  foreign  partners,  the  global  security  environment 
is  more  precarious  and  complex  as  any  time  in  the  memory,  and  growing  more  dangerous  every 
day.”  15  Senator  Robert  Menendez  (Democrat-New  Jersey)  Chairman  of  the  Senate  Foreign 
Relations  Committee  Hearing  on  “National  Security  and  Foreign  Policy  Priorities  in  the  fiscal 
year  2015  International  Affairs  Budget  “in  this  complex  and  rapidly  changing  global 
environment,  we  also  know  that  our  national  security  interests  are  priority  number  one  and  they 
cannot  be  jeopardized.”16  Lastly  and  more  succinctly,  US  President  Barrack  Obama,  while 


http://grist.org/politics/could-chuck-hagel-likely-defense-secretary-nominee-tum-out-to-be-a- 

climate-hawk/. 

13“Advance  Policy  Questions  for  the  Honorable  Chuck  Hagel:  Nominee  to  be  Secretary 
of  Defense,”  The  Atlantic,  accessed  February  11,  2015, 

http://cdn.theatlantic.conf  static/mt/assets/steve_clemons/BGOV%20Hagel%20Adv%20Policy% 
20Questions.pdf. 

14Hearing  before  the  Senate  Committee  on  Armed  Services,  Current  and  Projected 
National  Security  Threats  to  the  United  States,  1 1 1th  Cong.,  2d  sess.,  February  2,  2010. 

15Hearing  before  the  HR  Committee  on  Aimed  Services,  Current  and  Future  Worldwide 
Threats  to  the  National  Security  of  the  United  States,  1 13th  Cong.,  2nd  Sess.,  February  11,  2014. 

16Hearing  before  the  Senate  Foreign  Relations  Committee,  National  Security  and  Foreign 
Policy  Priorities  in  FY 15  International  Affairs  Budget,  1 13th  Cong.,  2nd  Sess.,  April  8,  2014. 
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addressing  the  press  on  the  multitude  of  foreign  crises  facing  the  United  States  said,  “We  live  in  a 
complex  world  and  at  a  challenging  time.”17 

American  policy  leaders  also  established  the  complex  security  environment  as  the 
foundation  in  official  national  security  policies  and  strategies.  These  documents  provide  guidance 
to  government  departments,  enabling  them  to  set  priorities  and  shape  policy.  The  2010  National 
Security  Strategy  (NSS)  sets  the  priorities  and  framework  for  the  whole  of  American  government. 
The  NSS  opens,  “At  the  dawn  of  the  21st  century,  the  United  States  of  America  faces  a  broad  and 
complex  array  of  challenges  to  our  national  security.”18  In  accordance  with  the  NSS  the  Office  of 
the  Director  of  National  Intelligence  released  the  National  Intelligence  Strategy  2014  stating  in 
the  current  environment,  “The  United  States  faces  a  complex  and  evolving  security  environment 
with  extremely  dangerous,  pervasive,  and  elusive  threats.”19  Lastly,  the  United  States  Department 
of  State-USAID  fiscal  year  2014-2017  Joint  Strategic  Plan  states,  “Today,  the  United  States  faces 
diverse  and  complex  security  challenges  [which]  . . .  directly  threaten  U.S.  interests  and  foreign 
policy  objectives.”20 

The  Department  of  Defense  also  incorporates  the  NSS  with  several  strategic  papers 
framing  and  expanding  the  understanding  of  the  global  environment  as  complex.  The  2010 
Quadrennial  Defense  Review  states,  “The  United  States  faces  a  complex  and  uncertain  security 
landscape  in  which  the  pace  of  change  continues  to  accelerate.  The  distribution  of  global  political, 

17Cheryl  K.  Chumley,  “Obama  Pleads  for  Patience  On  His  Foreign  Policy:  'We  Live  in  a 
Complex  World',”  Washington  Times,  July  17,  2014,  accessed  November  6,  2014, 
http://www.washingtontimes.com/news/2014/jul/17/obama-pleads-patience-his-foreign-policy- 
we-live-c/. 

18Barack  Obama,  National  Security  Strategy’  (Washington,  DC:  The  White  House,  May 

2010),  1. 

19James  R.  Clapper,  National  Intelligence  Strategy >  of  the  United  States  of  America 
(Washington,  DC:  Office  of  the  Director  of  National  Intelligence,  September  2014),  4. 

20John  Kerry,  Department  of  State  and  USAID  Strategic  Plan  FY  2014-201 7 
(Washington,  DC:  Department  of  State,  April  2,  2014),  1. 
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economic,  and  military  power  is  becoming  more  diffuse.”21  The  2012  Defense  Strategic 
Guidance  states,  “Global  security  environment  presents  an  increasingly  complex  set  of  challenges 
and  opportunities  to  which  all  elements  of  U.S.  national  power  must  be  applied.”22  In  accordance 
with  the  2014  Quadrennial  Defense  Review,  “The  global  trends  that  will  define  the  future 
security  environment  are  characterized  by  a  rapid  rate  of  change  and  a  complexity  bom  of  the 
multiple  ways  in  which  they  intersect  and  influence  one  another.  As  a  result,  despite  the  growing 
availability  and  flow  of  information  around  the  world,  it  is  increasingly  challenging  to  predict 
how  global  threats  and  opportunities  will  evolve.”23Additionally,  the  2014  United  States  Army 
Operational  Concept,  titled  “Win  in  a  Complex  World”,  describes  a  complex  environment  that  is 
“not  only  unknown,  but  unknowable  and  constantly  changing.”24 

Statements  by  public  officials  and  policy  documents  show  a  trend  in  which  the  global 
security  environment  is  becoming  more  complex  each  year.  It  is  important  to  note  the  complexity 
is  not  due  to  multiple  threats,  but  rather  increased  interconnectedness  of  the  global  environment.25 
In  1945,  following  the  end  of  World  War  II,  there  were  fifty-one  member  states  in  the  United 
Nations.  With  the  addition  of  South  Sudan  in  201 1,  there  are  currently  193  United  Nations 


21Robert  M.  Gates,  Quadrennial  Defense  Review  (Washington,  DC:  U.S.  Department  of 
Defense,  February  2010),  iii. 

22 Sustaining  U.S.  Global  Leadership:  Priorities  for  21s'  Century  Defense  (Washington, 
DC:  U.S.  Department  of  Defense,  January  2012.  accessed  December  5,  2014, 
http://www.defense.gov/news/defense_strategic_guidance.pdf. 

23Charles  Hagel,  Quadrennial  Defense  Review  (Washington,  DC:  U.S.  Department  of 
Defense,  March  2014),  7. 

24Training  and  Doctrine  Command  (TRADOC)  Pamphlet  525-3-1,  The  U.S.  Army 
Operating  Concept:  Win  in  a  Complex  World  2020-2040  (Washington,  DC:  Government  Printing 
Office,  2013),  iii. 

25Rosa  Brooks,  “Warning:  Winter  Metaphor  Alert!,”  Foreign  Policy,  February  13,  2014, 
1,  accessed  November  11,  2014,  http://foreignpolicy.com/2014/02/13/warning-winter-metaphor- 
alert /. 
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member  states.26  In  1950,  the  global  population  was  2.5  billion  people.  Sixty  years  later  the 
global  population  nearly  tripled  to  seven  billion  people  in  201 1. 27  People  and  goods  are  also 
moving  around  the  world  in  greater  quantities  and  faster  than  ever  before  as  well.  In  the  1950s,  3 1 
million  passengers  flew  annually.28  In  2012,  an  estimated  2.9  billion  passengers  used  air 
transportation,  and  an  estimated  13.6  billion  passengers  are  expected  to  fly  in  20 16. 29  According 
to  the  World  Trade  Organization,  the  global  value  of  international  trade  nearly  tripled  from  6.27 
trillion  USD  in  2000  to  18.3  trillion  USD  in  2013. 30  The  transfer  of  information  is  increasing 
even  faster.  In  1971,  computer  engineer  Ray  Tomilson  sent  the  first  email  on  the  Department  of 
Defense  Advanced  Research  Projects  Agency  Network  (ARPANET).31  In  2013,  businesses  alone 
send  over  100  billion  emails  a  day.  32  Furthermore  in  2014,  the  estimated  number  of  active  mobile 
phone  subscriptions  is  expected  to  surpass  the  global  population  and  the  total  number  of  objects 
connected  to  the  internet  is  to  surpass  twenty-five  billion  in  20 1 5  and  surpass  fifty  billion  in 


26“Growth  in  United  Nations  Membership,  1945-Present,”  United  Nations,  accessed 
December  5,  2014,  http://www.un.org/en/members/growth.shtml. 

27“World  Population,”  United  States  Census  Bureau,  accessed  December  5,  2014, 
http://www.census.gov/population/intemational/data/worldpop/table_population.php. 

28“Global  Air  Transport  Continues  to  Expand,”  Worldwatch  Institute,  December  17, 
2013,  accessed  December  5,  2014,  http://www.worldwatch.org/global-air-transport-continues- 
expand. 


29“ Annual  Passenger  Total  Approaches  3  Billion  According  to  ICAO  2012  Air  Transport 
Results,”  International  Civil  Aviation  Organization,  December  18,  2012,  accessed  December  5, 
2014,  http://www.icao.int/Newsroom/Pages/annual-passenger-total-approaches-3-billion- 
according-to-ICAO-20 12-air-transport-results. aspx. 

30“Statistical  Database  -  Total  Merchandise  Trade,”  World  Trade  Organization,  accessed 
December  5,  2014, 

http://stat.wto. org/StatisticalProgram/WSDBStatProgramSeries.aspx?Language=E. 

31Todd  Cambell,  “The  First  Email  Message,”  University  of  Maryland  Museum  of  User 
Interfaces,  accessed  December  1,  2014,  http://www.cs.umd.edu/class/spring2002/cmsc434- 
0101  /MUIseum/  applications/ firstemail.html. 

32Sara  Radicati,  Email  Statistics  Report,  2013-2017  (London:  The  Radicati  Group,  Inc., 


2013). 


2020. 33  The  cumulative  effect  is  the  creation  of  a  global  network  of  people  that  is  unprecedented 
in  history. 

Despite  understanding  the  complexity  in  the  environment,  numerous  international  events 
caught  senior  US  officials  and  policymakers  by  surprise  and  quickly  turned  into  policy  crises. 
Senior  officials  regularly  describe  these  surprises  as  intelligence  failures  and  failures  in  warning. 
The  most  significant  intelligence  failure  since  the  end  of  the  Cold  War  is  the  failure  to  identify 
and  warn  about  the  September  11,  2001  terrorist  attacks  in  New  York,  Pennsylvania,  and 
Washington  DC.  Since  then,  a  series  of  warning  failures  undermined  the  Intelligence 
Community’s  ability  to  support  policymakers.  A  2010  Senate  report  chastised  the  Intelligence 
Community  for  failing  to  identify  the  2009  Christmas  day  attempted  bombing  of  a  US  airliner.34 
The  wave  of  popular  protests  across  North  Africa  and  the  Middle  East,  beginning  in  late  2010  and 
popularly  referred  to  as  the  “Arab  Spring,”  resulted  in  the  removal  of  autocratic  leaders  in 
Tunisia,  Egypt,  Yemen;  US  military  action  in  Libya;  and  the  ongoing  civil  war  in  Syria.  Deputy 
Director  of  the  Defense  Intelligence  Agency  David  Shedd  stated  the  Intelligence  Community 
failed  to  provide  warning  of  events  that  transformed  power  structures  in  the  region  by  stating 
simply,  “We  missed  that.”35  Stemming  from  the  “Arab  Spring,”  a  US  Senate  Committee  on 
Homeland  Security  and  Governmental  Affairs  report  found  the  Intelligence  Community  failed  to 


33  Joshua  Primas,  “Number  of  Mobile  Phones  to  Exceed  World  Population  by  2014,” 
Digital  Trends,  February  28,  2013,  accessed  December  11,  2014, 

http://www.digitaltrends.com/mobile/mobile-phone-world-population-2014/.;  Dave  Evans,  The 
Internet  of  Things:  How  the  Next  Evolution  of  the  Internet  Is  Changing  Everything  (San  Jose: 
Cisco  1BSG,  2011). 

34Senate  Select  Committee  on  Intelligence,  Unclassified  Exectutive  Summary  of  the 
Committee  Report  on  the  Attempted  Terrorist  Attack  on  Northwest  Airlines  Flight  253,  1 1 1th 
Cong.,  2d  sess..  May  18,  2010. 

35Ken  Dilanian,  “U.S.  Intelligence  Official  Acknowledges  Missed  Arab  Spring  Signs,” 
Los  Angeles  Times,  July  19,  2012,  accessed  December  1 1,  2014, 

http://latimesblogs.latimes.com/world_now/2012/07/us-intelligence-official-acknowledges- 

missed-signs-ahead-of-arab-spring-.html. 
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provide  adequate  warning  of  the  localized  terrorist  threat,  which  resulted  in  the  September  11, 
2012  terrorist  attack  in  Benghazi  and  the  death  of  US  Ambassador  John  C.  Stevens.36  Also 
described  as  an  intelligence  failure  is  the  rapid  expansion  of  the  Islamic  State  of  Iraq  and  the 
Levant  (1SIL)  into  Iraq  in  mid-2014  and  the  ensuing  collapse  of  Iraqi  Security  Forces.  In  a  late 
September  2014  interview,  President  Obama  claimed  the  Intelligence  Community  underestimated 
the  threat  posed  by  the  terrorist  group.37  Lastly,  also  in  2014,  members  of  Congress  publically 
lamented  their  inability  to  take  action  to  prevent  Russia  from  intervening  in  Ukraine  and  annexing 
the  Crimea  territory  due  to  a  lack  of  warning  of  Russian  intentions.38 


When  Warning  Fails 

Intelligence  remains  our  basic  national  instrument  for  anticipating  danger:  military, 
political  and  economic. 

-As  former  CIA  Director,  President  George  Herbert  Walker  Bush  (199 1)39 


The  perception  of  the  Intelligence  Community’s  increasing  failure  to  provide  adequate 
warning  is  a  result  of  the  community’s  inability  to  keep  pace  with  the  rapidly  changing  security 
environment  and  policymakers’  demands.  The  US  Intelligence  Community  recognizes  that  its 


36Joseph  1.  Lieberman  and  Susan  M.  Collins,  “Flashing  Red:  A  Special  Report  on  the 
Terrorist  Attack  at  Benghazi,”  United  States  Senate  Committee  on  Homeland  Security  and 
Governmental  Affairs,  1 12th  Cong.,  2d  sess.,  December  30,  2012. 

37Steve  Kroft,  “President  Obama:  What  Makes  Us  America,”  60  Minutes,  September  28, 
2014,  1,  accessed  December  11,  2014,  http://www.cbsnews.com/news/president-obama-60- 
minutes/. 

38Josh  Gerstein  and  Burgess  Everett,  “Ukraine:  Why  Didn't  the  U.S.  Know  Sooner?,” 
Politico,  March  4,  2014,  1,  accessed  December  11,  2014, 

http://www.politico.com/story/20 14/03/united-states-barack-obama-ukraine-crimea-russia- 
vladimir-putin- 1 04264.html. 

39John  Brennan,  “Remarks  for  Central  Intelligence  Agency  Director  John  O.  Brennan  as 
Prepared  for  Delivery  at  the  Conference  On  the  Ethos  and  Profession  of  Intelligence,  Georgetown 
University,”  Central  Intelligence  Agency,  June  1 1,  2014,  accessed  December  1 1,  2014, 
https://www.cia.gov/news-information/speeches-testimony/2014-speeches-testimony/remarks- 
for-cia-director-brennan-at-georgetown-conference.html. 
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highest  priority  is  to  provide  timely  and  accurate  warning  to  policymakers  and  military 
commanders.  In  1992,  Robert  Gates,  then-Director  of  Central  Intelligence  (DC1),  created  a  task 
force  to  review  the  US  intelligence  warning  structure  following  the  end  of  the  Cold  War.  The 
group’s  findings,  DCI  Task  Force  Report:  Improving  Intelligence  Warning  29  May  1992, 
observed  that  “providing  policymakers  with  persuasive  intelligence  warning  -  in  time  for  them  to 
act  in  ways  that  influence  a  potential  foreign  development  likely  to  be  adverse  to  the  interests  of 
the  United  States  -  is  the  most  important  service  the  [Intelligence]  Community  can  perform  for 
the  security  of  the  U.S.”40  Twenty  years  later,  following  the  terrorist  attacks  on  September  11, 
2001,  the  ability  to  provide  warning  remains  a  fundamental  mission.  The  Director  of  National 
Intelligence  lists  anticipatory  intelligence  [warning]  as  a  foundational  intelligence  mission  the 
Intelligence  Community  must  accomplish.41  Similarly,  Dr.  Michael  G.  Vickers,  Under  Secretary 
of  Defense  for  Intelligence,  calls  intelligence  “our  first  line  of  defense  for  warning,  given  the 
array  of  global  threats  we  face.”42  Additionally,  the  three  all-source  intelligence  producers  within 
the  Intelligence  Community  (the  Central  Intelligence  Agency  (CIA),  D1A,  and  Department  of 
State  Bureau  of  Intelligence  and  Research)  and  the  technical  collection  members  (the  National 
Geospatial-intelligence  Agency,  National  Security  Agency,  and  National  Reconnaissance  Office) 
all  identify  warning  as  a  core  mission.43 


40Gordon  Negus,  “DCI  Task  Force  Report:  Improving  Intelligence  Warning,”  Central 
Intelligence  Agency,  Washington,  DC,  29  May  1992,  accessed  December  5,  201 1, 
http://www.documentcloud.org/documents/368903-1992-05-29-dci-task-force-report- 
improving.html. 

41Clapper,  2014  National  Intelligence  Strategy,  6. 

42 Atlantic  Council,  “Intelligence  in  a  Dynamic  World”  (video),  January  21,  2015, 
accessed  February  11,  2015,  http://www.atlanticcouncil.org/events/webcasts/intelligence-in-a- 
dynamic-world. 

43Ronald  L.  Burgess,  Jr.,  2012-201 7  Defense  Intelligence  Agency  Strategy’  (Washington, 
DC:  Defense  Intelligence  Agency,  2012),  2.;  Keith  Alexander,  NSA/CSS  Strategy >  (Washington, 
DC:  National  Security  Agency,  June  2010),  1.;  Letitia  Long,  NGA  Strategy’:  2013-2017 
(Washington  DC:  National  Geospatial-intelligence  Agency,  2013),  5. 
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However,  the  majority  of  intelligence  failures  are  understood  to  be  linked  to  a  failure  to 
provide  adequate  warning,  as  evidenced  by  the  relatively  recent  string  of  policymakers  feeling 
surprised  by  global  events  and  a  review  of  academic  and  professional  literature.  Consistently, 
investigations  show  that  major  intelligence  failures  are  the  result  of  the  Intelligence  Community’s 
inability  to  make  meaningful  warning  judgments  from  dispersed  raw  intelligence.  No  failures 
were  due  to  a  simple  lack  of  information.44  Instead  a  review  of  the  literature  finds  the  causes  for 
intelligence  failures  to  fall  into  three  basic  schools  of  thought.  The  first  category  identifies 
structural  and  systemic  limitations  within  the  Intelligence  Community  which  prevent  the 
necessary  information  from  being  collected,  analyzed,  and  sent  to  the  policymakers  who  need  it. 
The  second  category  attributes  intelligence  failures  on  the  cognitive  limitations  of  intelligence 
analysts  to  recognize  threats  until  they  have  already  materialized.  Lastly,  the  third  category 
emphasizes  the  lack  of  understanding  and  action  by  policymakers  as  the  cause  for  intelligence 
failures.  In  addition  to  identifying  root  causes  for  intelligence  failures,  each  school  of  thought 
offers  differing  solutions  to  the  problem. 

Failure  1:  Structure  of  the  Intelligence  Community 

The  structural  failure  school  of  thought  focuses  on  how  well  (or  not)  the  Intelligence 
Community  receives  information,  processes  it  internally,  and  passes  it  on  to  policymakers.  The 
underlying  assumption  in  the  arguments  is  the  lack  of  centralized  control  and  inefficient 
processes  are  fundamental  to  intelligence  failures.  Reviews  by  the  executive  branch  identified 
structural  problems  within  the  Intelligence  Community  shortly  after  the  passage  of  the  National 
Security  Act  of  1947  (Public  Law  80-162)  and  the  creation  of  the  Director  of  Central  Intelligence, 


44Negus  2.;  National  Commission  on  Terrorist  Attacks  upon  the  United  States,  Thomas 
H.  Kean,  and  Lee  Hamilton.  The  9/1 1  Commission  Report:  Final  Report  of  the  National 
Commission  on  Terrorist  Attacks  Upon  the  United  States.  (Washington,  DC:  Government 
Printing  Office,  2004). 
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formalizing  distinct  intelligence  agencies  into  a  confederated  community  (consisting  of  small 
intelligence  components  within  the  Armed  Services,  Department  of  State,  Department  of  the 
Treasury,  the  Federal  Bureau  of  Investigation,  and  the  CIA).45  In  1949  the  Task  Force  on 
National  Security  Organization,  part  of  the  First  Hoover  Commission,  identified  a  lack  of 
coordination  and  transference  of  information  within  the  nascent  Intelligence  Community.  Also,  in 
1949,  the  Intelligence  Survey  Group,  established  by  the  National  Security  Council,  evaluated  the 
CIA’s  effort  and  its  relationship  with  other  agencies.46  The  group’s  findings,  also  referred  to  as 
the  Dulles-Jackson-Correa  Report,  were  highly  critical  of  the  quality  of  national  intelligence 
estimates  and  the  failure  of  the  Director  of  National  Intelligence  to  lead  the  coordination  between 
the  intelligence  agencies.47  Additional  government  reports  and  inquiries  from  1955  to  2002 
consistently  found  similar  structural  faults  within  the  Intelligence  Community.48  Amy  Zegart,  a 
leading  scholar  on  the  structural  flaws  of  the  Intelligence  Community,  summarizes  these  findings 
by  describing  the  notion  of  the  United  States  Intelligence  Community  as  a  unified  actor  in  the 
American  national  security  system  is  a  constructed  falsity.  According  to  Zegart,  the  seventeen 
members  of  the  current  Intelligence  Community  never  acted  as  a  unified  group.  Rather,  the 
various  agencies  were  created  at  “different  times  for  different  purposes  without  strong  unifying 
authorities  or  structures;  common  policies. . .  and  cultures  to  ensure  they  operated  in  a  coordinated 
fashion.”49 


45House  Committee  on  Permanent  Select  Committee  on  Intelligence,  IC21  The 
Intelligence  Community  in  the  21st  Century,  104th  Cong.,  2d  sess.,  1996,  H.  Doc.,  1. 

46Ibid. 

47Ibid. 

48Ibid.;  National  Commission  on  Terrorist  Attacks  upon  the  United  States. 

49Joshua  Rovner,  Austin  Long,  and  Amy  B.  Zegart,  “How  Intelligent  Is  Intelligence 
Reform?,”  International  Security  30,  no.  4  (Spring  2006):  206. 
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The  largest  obstacles  identified  preventing  information  sharing  within  the  Intelligence 
Community  are  cultural  and  bureaucratic.  British  political  scientist  Philip  H.J.  Davies  research 
identified  three  cultural  tendencies  within  intelligence  agencies,  not  peculiar  to  the  United  States, 
that  play  a  role  in  reduced  information  collection  and  sharing.  The  first  is  the  desire  to  maintain 
secrecy  and  limit  access  to  information.50  Security  and  classification  rules  meant  to  prevent 
unauthorized  disclosures  and  protect  sources  and  methods  create  an  environment  that  limits 
interaction  between  agencies.  The  cultural  emphasis  on  secrecy  also  limits  the  number  of 
individuals  analyzing  intelligence  by  keeping  out  the  perspectives  of  subject  matter  experts  from 
discussions  due  to  their  lack  of  a  security  clearance. 51  Furthermore,  cultural  and  bureaucratic 
propensities  emphasize  institutional  survival  over  cooperation.  The  bureaucracies  of  the 
individual  Intelligence  Community  members  resist  reform  efforts  in  order  to  preserve  autonomy 
and  power.  Furthermore,  the  structure  of  government  agencies  internal  reward  programs 
incentivize  maintaining  the  status  quo  of  reliability  instead  of  the  innovation  of  private 
enterprises.52 

Structural  reforms  are  the  most  public  because  policy  makers  and  the  public  perceive 
them  to  be  the  easiest  to  fix  through  simple  bureaucratic  and  legislative  changes.  The  reforms 
preferred  by  the  structural  failure  school  favor  the  centralization  of  control  of  the  Intelligence 
Community  in  order  to  reshape  the  culture  and  reduce  bureaucratic  barriers  to  reform.  The 
governmental  panels  reviewing  the  Intelligence  Community  structure  regularly  recommended 
creating  a  position  in  which  coordination  within  the  Intelligence  Community  was  centralized.  The 


50Philip  H.J.  Davies,  “Intelligence  Culture  and  Intelligence  Failure  in  Britain  and  the 
United  States,”  Cambridge  Review  of  International  Affairs  17,  no.  3  (October  2004):  496. 

51Richard  L.  Russell,  “Intelligence  Failures:  The  Wrong  Model  for  the  War  on  Terror,” 
Policy  Review,  no.  123  (February-March  2004):  61-62. 

52Amy  B.  Zegart,  “An  Empirical  Analysis  of  Failed  Intelligence  Reforms  Before 
September  11,”  Political  Science  Quarterly  121,  no.  1  (Spring  2006):  58-59. 
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Intelligence  Reform  and  Terrorism  Prevention  Act  of  2004  sought  to  correct  many  of  the 
systemic  problems  identified  in  the  9/11  Commission  Report  and  other  bipartisan  and 
independent  government  commissions.53  The  law’s  most  significant  change  to  the  Intelligence 
Community  was  the  creation  of  the  Office  of  the  Director  of  National  Intelligence  (DNI).  While 
lacking  full  budgetary  and  personnel  authority  over  the  Intelligence  Community,  the  Office  of  the 
DNI  is  responsible  for  unifying  the  Intelligence  Community  through  coordinated  analysis  and 
collection,  developing  common  professional  standards,  and  removing  communication  barriers  in 
order  to  “forge  an  Intelligence  Community  that  delivers  the  most  insightful  intelligence 
possible.”54  However,  critics  argue  the  DNI  reforms  are  insufficient  to  enforce  the  necessary 
changes  and  the  legislature  needs  to  give  greater  authority  to  the  DNI.55 

Failure  2:  Analyst’s  understanding 

The  cognitive  limitations  school  of  thought  focuses  on  how  well  (or  not)  analysts  are  able 
to  discern  threats,  despite  allegedly  having  all  the  necessary  information  available.  The  press 
popularly  refer  to  this  type  of  failure  as  either  “failure  to  connect  the  dots”  or  “failure  of 
imagination.”56  Furthermore,  this  school  of  thought  emphasizes  how  analysis  is  a  human 
endeavor,  limited  by  the  human’s  ability  to  process  information;  as  described  by  Dr.  Michael 


53Eric  Rosenbach  and  Aki  J.  Peritz,  Confrontation  or  Collaboration:  Congress  and  the 
Intelligence  Community  (Cambridge:  Harvard  Kennedy  School  of  Government,  2009). 

54  “Mission,  Vision,”  Office  of  the  Director  of  National  Intelligence,  accessed  February 
14,  2015,  http://www.dni.gov/index.php/about/mission. 

55Amy  B.  Zegart,  “An  Empirical  Analysis  of  Failed  Intelligence  Reforms  Before 
September  1 1 ,”  Political  Science  Quarterly  121,  no.  1  (Spring  2006):  58-59. 

56Robert  D.  Behn,  “The  Beguiling  Connecting-the-Dots  Metaphor,”  Bob  Behn ’s 
Performance  Leadership  Report  8,  no.  5  (January  2010):  1.;  Scott  Atran,  “A  Failure  of 
Imagination  (Intelligence,  WMDs,  and  “Virtual  Jihad”),”  Studies  in  Conflict  and  Terrorism  29, 
no.  3  (April/May  2006):  285-300.;  Thomas  H.  Kean,  and  Lee  Hamilton.  The  9/11  Commission 
Report:  Final  Report  of  the  National  Commission  on  Terrorist  Attacks  Upon  the  United  States. 
(Washington,  DC:  Government  Printing  Office,  2004). 
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Handel,  a  Professor  of  National  Security  Affairs  at  the  US  Army  War  College  and  founder  of  the 
journal  Intelligence  and  National  Security,  . .  the  weakest  link  in  the  intelligence  process  -  is 
human  nature.”57  Former  Israeli  military  intelligence  officer  Zvi  Lanir  adds,  “surprises. . .  come 
from  the  limits  of  people’s  knowledge  and  understanding  of  their  environment  and  themselves.”58 
Military  historian  Roberta  Wohlstetter’s  book,  Pearl  Harbor:  Warning  and  Decision ,  describes 
the  analysts  challenge  as  separating  “signals”  from  “noise.”  Signal  in  this  case  are  “clue  or  a  sign 
or  a  piece  of  evidence  that  tells  about  a  particular  danger  or  a  particular  enemy  move  or 
intention.”59  Noise  is  “the  background  of  irrelevant  or  inconsistent  signals,  signs  pointing  in  the 
wrong  directions,  that  tend  always  to  obscure  the  signs  pointing  the  right  way.”60 

The  analyst’s  ability  to  identify  a  threat  by  discerning  the  “signals”  from  the  “noise”  is 
hindered  by  the  analyst’s  own  cognitive  biases  and  inability  to  process  large  amounts  of 
information.  Former  CIA  officer  Richards  J.  Heuer,  Jr.  described,  in  his  book  Psych o l ogy  of 
Intelligence  Analysis,  how  people  unconsciously  use  mental  shortcuts  to  deal  with  complex  and 
ambiguous  information.  Cognitive  bias  is  when  these  mental  shortcuts  are  misapplied  and  result 
in  mental  errors.61  Heuer  also  described  how  analyst  bring  biases  to  an  analytic  problem  stating, 
“intelligence  analysts  do  not  approach  their  tasks  with  empty  minds.  They  start  with  a  set  of 


57Michael  I.  Handel,  War,  Strategy’  and  Intelligence  (Studies  in  Intelligence)  (New  York: 
Franck  Cass,  1989),  34. 

58Zvi  Lanir,  Fundamental  Surprises  (Eugene,  Oregon:  Decision  Research,  1986):  1. 

59Roberta  Wohlstetter,  Pearl  Harbor:  Warning  and  Decision  (Stanford,  CA:  Stanford 
University  Press,  1962),  2. 

60Roberta  Wohlstetter,  “Cuba  and  Pearl  Harbor:  Hindsight  and  Foresight,”  Foreign 
Affairs  (July  1965):  1,  accessed  February  1 1,  2015, 

http://www.foreignaffairs.com/articles/23722/roberta-wohlstetter/cuba-and-pearl-harbor- 

hindsight-and-foresight. 

61Richards  J.  Heuer,  Psychology >  of  Intelligence  Analysis,  2nd  ed.  (Washington,  DC: 
Center  for  the  Study  of  Intelligence,  Central  Intelligence  Agency,  2001),  111. 
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assumptions  about  how  events  normally  transpire  in  the  area  for  which  they  are  responsible.”62 


These  initial  set  of  assumptions  shape  analysis  in  favor  of  what  the  analyst  expects  to  see.63 
Israeli  political  scientist  Uri  Bar-Joseph  described  how  this  phenomena  directly  led  to  Israeli 
intelligence’s  failure  to  warn  about  the  Egyptian  and  Syrian  invasion  in  the  1973  Yom  Kippur 
War.  Despite  closely  monitoring  the  Egyptian  and  Syrian  war  preparations  and  warned  of  both 
countries’  intention  for  war,  Israeli  intelligence  maintained  their  belief  that  the  Arab  states  did  not 
believe  they  could  prevail  militarily  against  Israel.  The  day  before  the  invasion,  Director  of 
Military  Intelligence  Eli  Zeira  briefed  Prime  Minister  Golda  Meir:  “We  still  see  as  highly 
probable  the  possibility  that  the  Egyptian  and  the  Syrian  state  of  alert  derives  from  fear  from  us, 
and  as  slightly  probable  the  possibility  that  the  real  intention  of  Egypt  and  Syria  is  to  carry  out 
hostile  acts  on  a  limited  scale.”64 

Two  solutions  provided  to  counter  the  analyst’s  cognitive  blocks  to  identifying  emerging 
threats  are  training  and  procedural  structures.65  Training  programs  emphasize  the  concept  of 
alternative  analysis,  “techniques  that  seek  to  help  analysts  and  policymakers  to  stretch  their 
thinking  by  broadening  the  array  of  outcomes  considered  or  by  challenging  underlying 
assumptions  that  may  constrain  thinking”66  These  techniques  are  taught  at  initial  and  annual 


62lbid„  5. 

63Uri  Bar-Joseph  and  Jack  S.  Levy,  “Conscious  Action  and  Intelligence  Failure,” 

Political  Science  Quarterly  124,  no.  3  (Fall  2009):  465. 

64Uri  Bar-Joseph,  “Israel's  1973  Intelligence  Failure,”  Israel  Affairs  6,  no.  1  (Autumn 
1999):  11-25. 

65McKinsey&Company  “Focused  On  Foresight:  An  Interview  with  the  US's  National 
Intelligence  Officer  for  Warning”  (video),  September  2009,  accessed  February  1 1,  2015, 
http://www.mckinsey.com/insights/public_sector/focused_on_foresight_an_interview_with_the_ 
ussnationalintelligenceofficerforwarning. 

66Fishbein,  Warren,  and  Gregory  Treverton.  “Making  Sense  of  Transnational  Threats.” 
The  Sherman  Kent  Center  for  Intelligence  Analysis  Occasional  Papers  3,  no.  1  (October  2004):  1, 
Accessed  February  14,  2015,  https://www.cia.gov/library/kent-center-occasional- 
papers/vol3no  1  .htm. 
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training  programs  for  analysts,  such  as  the  D1A  Defense  Intelligence  Strategic  Analysis  Program 
(DISAP),  which  teach  analyst  about  cognitive  biases  and  heuristics  in  order  to  make  them  aware 
of  mental  traps  affecting  their  analysis.67  Books  like  Dr.  Richard  Paul  and  Dr.  Linda  Elder’s  The 
Miniature  Guide  to  Critical  Thinking:  Concepts  and  Tools  are  standard  issue  to  assist  analyst  in 
clearly  evaluating  the  information  analyzed.68  Furthermore,  analysts  training  in  basic  and 
advanced  structured  analytic  techniques,  such  as  network  analysis;  matrixes;  analysis  of 
competing  hypothesis;  and  argument  mapping,  provide  additional  supports  for  analyst  to  visualize 
the  information  and  make  additional  connections.69  In  addition  to  individual  training, 
organizational  structures  also  act  to  check  inherent  cognitive  bias  of  the  analysts.  Programs  such 
as  red  teams  and  alternative  analysis  groups  provide  outside  points  of  view  from  the  desk  analyst 
and  challenge  key  assumptions  and  make  alternative  links  between  the  information. 70 

Failure  3:  Policymaker’s  action 

The  policymaker  school  of  thought  focuses  on  how  well  (or  not)  senior  leaders 
understand  the  warning  provided  by  analysts  and  are  able  to  take  action  to  mitigate  the  identified 
threat.  Political  scientist  Richard  K.  Betts,  in  his  1978  article,  “Analysis,  War,  and  Decision:  Why 
Intelligence  Failures  are  Inevitable,”  ultimately  places  the  cause  for  intelligence  failures  on 
policymakers,  stating,  “In  the  best-known  cases  of  intelligence  failure,  the  most  crucial  mistakes 


67Regional  Joint  Intelligence  Training  Facility,  FY  2011  Course  Catalog  (RAF 
Molesworth,  UK,  RJ1TF,  2011),  1-29.;  Bruce  Bennet,  “D1A  Analyst  Training  Requirements  and 
Competencies,”  Joint  Military  Intelligence  Training  Center  (Washington,  DC:  Defense 
Intelligence  Agency,  2008). 

68Finda  Elder  and  Richard  Paul,  A  Miniature  Guide  for  Students  and  Faculty  to  the 
Foundations  of  Analytic  Thinking:  How  to  Take  Thinking  Apart  and  What  to  Look  for  When  You 
Do;  The  Elements  of  Thinking  and  the  Standards  They  Must  Meet  (Dillon  Beach,  CA:  Foundation 
for  Critical  Thinking,  ©2003):  1. 

69Shelly  Freyn,  “Using  Structured  Intelligence  Methods  to  Improve  Indicator  and 
Warning  Analysis,”  Competitive  Intelligence  15,  no.  4  (October/December  2012),  22-29. 
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have  seldom  been  made  by  collectors  of  raw  information,  occasionally  by  professionals  who 
produce  finished  analyses,  but  most  often  by  the  decision  makers  who  consume  the  products  of 
intelligence  services. . .  Intelligence  failure  is  political  and  psychological  more  often  than 
organizational.” 71  However,  Dr.  John  A.  Gentry,  former  senior  analyst  on  the  staff  of  the 
National  Intelligence  Officer  for  Warning  (NIO-W),  does  not  let  analysts  off  the  hook,  asserting, 
“intelligence  officers  may  be  partly  responsible  if  they  present  accurate  warning  messages 
unpersuasively.”72  Exemplifying  this  point,  former  DIA  senior  analyst  Cynthia  Grabo  recounted 
an  Intelligence  Community  discussion  about  strategic  warning.  During  the  discussion  an  analyst 
described  how  analytic  methods  correctly  forecasted  the  North  Korean  invasion  of  South  Korea 
in  1950  and  the  ensuing  Chinese  intervention.  In  response  a  junior  analyst  responded,  “Yes,  but 
you  can’t  have  done  a  very  good  job,  because  no  one  believed  you,”  since  both  events  caught 
policymakers  by  surprise.73 

A  review  of  the  professional  and  academic  literature  identifies  four  primary  causes  for 
policymakers  not  to  take  action  when  given  warning.  The  first  cause  identified  is  policymakers  do 
not  understand  the  capabilities  and  limits  in  intelligence  collection,  analysis,  and  dissemination, 
and  as  a  result  maintain  unrealistic  assumptions.74  Martin  Petersen,  a  retired  senior  CIA 
intelligence  officer,  found  over  the  course  of  his  career  that  policymakers  form  their  initial 
impressions  of  the  Intelligence  Community  from  popular  media,  the  press,  and  congressional 

71Richard  K.  Betts  “Analysis,  War,  and  Decision:  Why  Intelligence  Failures  Are 
Inevitable,”  World  Politics  31,  no.  1  (October  1978):  61. 

72John  A.  Gentry,  “Intelligence  Failure  Reframed,”  Political  Science  Quarterly  123,  no.  2 
(November  2008):  249. 

73Cynthia  Grabo,  Handbook  of  Warning  Intelligence:  Assessing  the  Threat  to  National 
Security  (Lanham,  MD:  Scarecrow  Press,  2010),  ix. 

74Gentry,  247.;  Martin  Petersen,  “What  I  Learned  in  40  Years  of  Doing  Intelligence 
Analysis  for  Us  Foreign  Policy  Makers,”  Studies  in  Intelligence  55,  no.  1  (March  2011):  14.; 
Kenneth  Lieberthal,  The  U.S.  Intelligence  Community  and  Foreign  Policy:  Getting  Analysis  Right 
(Washington  DC:  The  Brookings  Institute,  2009). 
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reports  -  which  are  “not  always  the  most  accurate  or  sophisticated  sources  and  generally  not  the 
most  flattering.”75  Former  CIA  director,  Robert  Gates,  further  describes  the  expectations  held  by 
senior  leaders,  stating,  “Presidents  expect  that,  for  what  they  spend  on  intelligence,  the  product 
should  be  able  to  predict  coups,  upheavals,  riots,  intentions,  military  moves,  and  the  like  with 
accuracy.”76  Secondly,  due  to  the  multiple  demands  for  their  attention  and  compressed  decision 
cycles,  policymakers  lack  the  necessary  time  to  digest  available  information,  much  less  to  pursue 
understanding  assessed  threats.77  The  result  is  policymakers  have  what  political  scientist,  Dr. 
Matthew  Wahlert,  calls  conceptual  failure  -  “a  failure  to  perceive  the  context  of  the  incoming 
data.”78  Thirdly,  arising  from  the  previous  two  causes,  a  lack  of  trust  between  the  policymaker 
and  analyst  results  in  warning  failure.79  The  lack  of  trust  arises  from  a  failure  of  the  Intelligence 
Community  to  meet  expectations  described  above  and  from  the  “ambiguous  signals,  unconfirmed 
reports,  and  the  so-called  ‘cry-wolf’  syndrome  tend  to  depress  confidence  in  warning 
forecasts.”80  Additionally,  when  leaders  do  not  get  the  information  in  the  detail  they  expect,  they 
believe  the  Intelligence  Community  is  withholding  information  or  promoting  its  own  agenda.81 
Lastly,  failure  occurs  when  warning  counters  a  senior  leader’s  desired  policy  or  elevates  a  topic 


75Petersen  14. 

76Andrew  439. 

77Petersen  1 3 ;  Dietrich  Domer,  The  Logic  of  Failure:  Recognizing  and  Avoiding  Error  in 
Complex  Situations  (Reading,  MA:  Basic  Books,  1997),  44. 
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79Gentry  254. 
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of  lower  priority.  82United  States’  Ambassador  Paul  D.  Wolfowitz  provides  the  policymaker’s 
perspective  stating,  “The  analyst  has  to  understand  the  policymaker’s  intense  commitment  to  the 
success  of  his  policy...  Policymakers  will  not  gladly  give  up  hard-fought  premises.”83  The  result 
is  that  policy  makers  may  ignore  new  information  that  does  not  support  their  preconceived 
notions  or  challenges  the  status  quo.84  Which  is  their  prerogative,  as  Dr.  Gentry  describes  how 
intelligence  is  only  one  source  of  many  that  help  shape  policy  stating,  “But  even  clear, 
confidently  presented,  and  accurate  intelligence  warnings  cannot  place  the  messages  in  political 
contexts;  only  decision  makers  can  do  that,  making  intelligence  one  of  many  decision  inputs.”85 

The  proposed  solution  to  improving  policymaker-caused  warning  failures  is  to  make 
policymakers  better  intelligence  consumers.86  Dennis  C.  Wilder,  winner  of  the  2010  Galileo 
Intelligence  Community  Award  for  innovative  ideas,  recommended  an  educational  program  for 
newly  elected  leaders  and  their  staffs  to  increase  understanding  of  the  Intelligence  Community. 
Wilder  recommended  the  Office  of  the  DN1  manage  the  program.  However,  former  senior 
officials  from  both  political  parties  and  multiple  agencies  would  need  to  assist  in  developing  the 
program  to  avoid  allegations  of  the  Intelligence  Community  attempting  to  interfere  with  policy 
development.87  Additionally,  former  Special  Assistant  to  the  President  for  National  Security 
Affairs,  Dr.  Kenneth  Lieberthal,  identified  the  need  for  policymakers  to  keep  analysts  informed  of 

82Richard  K.  Betts  “Two  Faces  of  Intelligence  Failure:  September  1 1  and  Iraq's  Missing 
WMD,”  Political  Science  Quarterly  122,  no.  4  (2007-08):  587-588. 
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86lbid„  267-69. 
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discussions  with  foreign  leaders  to  make  sure  the  analysts  have  relevant  information  on  intentions 
and  motivations;  not  simply  assuming  the  analysts  already  know.88 


Methodology 

Research  for  this  monograph  focused  on  a  review  of  the  literature  covering  intelligence, 
warning,  intelligence  failures,  surprise,  and  complexity.  This  monograph  fills  a  gap  in  the 
literature  by  identifying  how  complexity  science  principles  can  be  used  to  address  the  three 
previously  identified  causes  of  intelligence  warning  failures.  This  paper  argues  that  complexity 
science  provides  greater  understanding  that  can  be  applied  to  mitigate  the  three  identified  causes 
of  intelligence  failures  -  structure  of  the  Intelligence  Community,  cognitive  understanding  of  the 
environment  and  identifying  emerging  threats,  and  communicating  complex  threats  to 
policymakers  to  support  decision  making.  Due  to  the  classification  restrictions  the  research  does 
not  include  warning  assessments,  techniques,  or  systems  currently  in  use.  Instead  the  research 
relies  heavily  on  declassified  documents  from  the  Intelligence  Community. 


Cold  War  Systems  in  a  Post-Cold  War  World 

The  Berlin  Wall  wasn ’t  the  only  barrier  to  fall  after  the  collapse  of  the  Soviet  Union  and 
the  end  of  the  Cold  War.  Traditional  barriers  to  the  flow  of  money,  trade,  people,  and 
ideas  also  fell. 


-  Fareed  Zakaria 89 


When  the  Cold  War  ended,  we  thought  the  world  had  changed.  It  had  -  but  not  in  the 
way  we  thought. 


-  Thomas  P.M.  Barnett,  The  Pentagon  ’s  New  Map 90 
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Warning  failures  are  a  result  of  the  US  Intelligence  Community  relying  on  linear,  static 
processes  to  address  nonlinear,  dynamic  environments.  The  US  Intelligence  Community,  as  it  is 
recognized  today,  was  created  to  address  the  lack  of  warning  available  to  the  President  and  senior 
government  officials  in  the  lead  up  to  World  War  II  and  to  address  the  challenge  posed  by  the 
Soviet  Union  following  the  war.  In  1946,  the  Joint  Committee  on  the  Pearl  Harbor  Attack 
recommended  the  establishment  of  a  unified  and  permanent  intelligence  effort  by  the  United 
States.  This  recommendation  became  a  reality  on  July  26,  1947  with  the  passage  of  the  National 
Security  Act  of  1947  which  created  the  National  Security  Council,  Department  of  Defense,  a 
Director  of  Central  Intelligence  (DCI),  and  the  CIA.  Executive  orders,  such  as  the  one  which 
created  the  National  Security  Agency  (NSA)  in  1952,  and  National  Security  Council  Intelligence 
directives  (NSCIDs),  which  allowed  the  creation  of  “departmental”  intelligence  activities,  further 
expanded  the  early  Intelligence  Community.91 

The  intelligence  warning  system  during  the  Cold  War  focused  on  the  military  threat 
posed  by  the  Soviet  Union  and  aligned  communist  states.  Following  the  lack  of  warning  of  the 
Berlin  blockade  in  1948  and  the  start  of  the  Korean  War  in  1950,  the  DCI  Walter  Bedell  Smith, 
established  the  National  Indications  Center  to  focus  on  the  military  mobilization  of  the  Soviet 
Union,  China,  North  Korea,  or  other  potential  areas  of  global  conflict.92  By  the  early  1970s  the 
focus  for  strategic  intelligence  warning  remained  unchanged.  Former  senior  analyst  at  the  DIA, 
Cynthia  Grabo  identified  the  three  primary  focus  areas  for  warning  analysis  during  the  Cold  War: 
military  action  by  Communist  states  against  the  United  States  or  its  allies,  major  developments  in 
which  Communist  states  may  become  involved,  and  military  action  by  Communist  states  against 

91  Senate  Committee  on  Select  Committee  to  Study  Governmental  Operations  with 
Respect  to  Intelligence  Activities,  Final  Report,  94th  Cong.,  2d  sess.,  1976,  S.  Rep.  94-75,  pt.  1. 

92Mary  McCarthy,  “The  National  Warning  System:  Striving  for  an  Elusive  Goal,” 
Defense  Intelligence  Journal  3,  no.  1  (Spring  1994):  5-19. 
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countries  not  allied  with  the  United  States.93  Kenneth  Knight,  National  Intelligence  Officer  for 
Warning  (NIO-W)  from  2004  to  2010,  described  the  Cold  War  threat  as  “static”,  state  centric,  and 
with  an  emphasis  on  the  military  -  where  the  bad  outcome  could  be  determined  before  the 
outcome  and  monitor  against  it.94Additionally,  former  CIA  analyst  Bruce  D.  Berkowitz  described 
the  analytic  and  collection  tasks  during  this  time  as  establishing  a  source  or  placing  a  sensor  to 
watch  a  military  base  and  wait  for  a  signal  that  activity  was  taking  place.  The  ability  to  gain  the 
necessary  access  to  the  information  and  the  threat  of  deception  made  the  work  challenging,  but 
the  overall  process  was  relatively  simple  and  straightforward.  Further  aiding  the  warning  analyst 
Berkowitz  added  the  Soviet  Union  was  slow,  moving  “at  the  speed  of  bureaucracy.”95  For  forty 
years,  the  US  warning  system  developed  a  structure  isolated  from  the  rest  of  the  Intelligence 
Community  with  a  focus  on  military  threats  and  senior  leaders  to  prevent  a  nuclear  world  war. 

By  the  end  of  the  Cold  War,  the  puipose  of  warning  analysis  expanded  “to  avoid  surprise 
to  the  President,  the  National  Security  Council,  and  to  the  Armed  Forces  of  the  United  States  by 
foreign  events  of  major  importance  to  the  security  of  the  U.S.”96  To  support  warning  in  the  new 
environment,  the  DC1  established  the  National  Intelligence  Warning  System.  The  constraints 
placed  on  establishing  a  warning  problem  in  the  new  system  were  vague  to  allow  analyst  to 
examine  threats  from  unpredictable  or  unimaginable  sources.97  Flowever,  according  to  Mary 
McCarthy,  NIO-W  in  the  mid-1990s,  the  focus  on  identifying  threats  remained  weighted  toward 
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identifying  events  that  would  require  the  use  of  military  force,  “from  the  scale  of  embassy 
evacuations  to  larger  military  activities,”  but  also  included  events  that  would  negatively  affect  US 
foreign  policy,  to  include  coup  d’etat,  third  party  wars,  and  refugee  surges.98 

In  2006,  the  DN1,  via  Intelligence  Community  Directive  (1CD)  201,  expanded  the  scope 
of  warning  intelligence  further  to  provide  “national  leaders  advance  warning  of  foreign 
developments,  events,  or  conditions  that  could  threaten  or  adversely  affect  US  interests, 
objectives,  policies,  or  actions.”99  The  movement  away  from  purely  military  and  security  threats 
is  an  attempt  to  address  how  the  warning  system  is  not  sufficient  to  address  the  new  global 
environment,  consisting  of  emerging  dynamic  problems  that  do  not  reside  solely  in  nation  states 
and  do  not  soley  involve  military  or  defense  threats.100  Secretary  of  Defense  Chuck  Hagel  stated, 
“our  future  security  challenges  will  be  defined  less  by  the  wars  of  the  past  decade  and  more  by 
emerging  complex  threats.”  '“'Additionally,  the  National  Defense  Strategy  of  2008  described  the 
Long  War  against  violent  extremist  movements  is  a  “more  long-term,  episodic,  multi-front,  and 
multi-dimensional  conflict  more  complex  and  diverse  than  the  Cold  War  confrontation  with 
communism.”'02  Focusing  on  the  intelligence  challenges,  Under  Secretary  of  Defense  for 
Intelligence  Dr.  Vickers  described,  during  an  early  2015  presentation,  how  during  the  Cold  War 
the  Intelligence  Community  faced  a  single  enduring  threat  in  the  Soviet  Union.  However,  in  the 
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current  environment  the  Intelligence  Community  struggles  to  confront  multiple  emerging  threats 
which  are  becoming  enduring  problems.103 

The  shift  from  threats  during  the  Cold  War  to  the  current  global  environment  are 
unprecedented  and  recognized  by  senior  policy  officials.  As  Secretary  of  Defense  Robert  M. 
Gates  wrote  in  2010,  “the  global  security  environment  changed  radically  since  then  [the  Cold 
War],  and  today  it  is  more  complex,  more  unpredictable,  and  even  without  a  superpower 
adversary,  in  many  ways  more  dangerous.”104  DNI  James  R.  Clapper,  in  comments  given  Senate 
Intelligence  hearing  on  national  security  threats  in  early  2014,  “. . .  looking  back  over  my  more 
than  half  a  century  in  intelligence,  I  don’t  think  we’ve  ever  faced  more  challenges. . .  suffice  to 
say  we  live  in  a  complex,  dangerous  world.”105  DIA  Director  Lieutenant  General  Michael  Flynn 
“what  I  see  each  day  is  the  most  uncertain,  chaotic,  and  confused  international  environment  that 
I’ve  witnessed  in  my  entire  career.”106  Lastly,  Secretary  of  State  John  Kerry  in  an  April  2014 
speech  said,  “During  the  Cold  War. . .  it  was  easier  than  today  -  simpler  is  maybe  a  way  to  put 
it...  The  choices  were  less  varied,  less  complicated,  more  stark,  more  clear.”107 
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The  threats  to  the  United  States,  presented  by  DNI  Clapper  to  the  Senate  Select 
Committee  on  Intelligence,  highlight  the  changes  in  the  threat  environment.  Which  now  include 
cyber,  counterintelligence,  terrorism,  weapons  of  mass  destruction  proliferation,  transnational 
organized  crime,  economic  trends,  natural  resources,  and  health  risks  as  global  threats.108  The 
World  Economic  Forum,  an  international  institution  seeking  to  promote  public-private 
cooperation  to  address  global  problems,  identified  similar  threats  in  its  Global  Risks  2014  report 
covering  ten  global  risks  of  highest  concern.  The  list  includes:  fiscal  crises  in  key  economies, 
structurally  high  unemployment -underemployment,  water  crises,  severe  income  disparity,  failure 
of  climate  change  mitigation  and  adaptation,  greater  incidence  of  extreme  weather  events,  global 
governance  failure,  food  crises,  failure  of  a  major  financial  mechanism-institution,  and  profound 
political  and  social  instability.109  Both  lists  describe  threats  that  are  complex  and  closely 
interrelated.  Furthermore,  Figure  1  shows  how  the  separate  threats  are  also  connected,  providing 
additional  complexity  to  the  global  environment  and  how  to  identify  which  threat  a  crisis  will 
arise  in  order  to  provide  adequate  warning. 


108Hearing  before  the  Senate  Select  Committee  on  Intelligence,  Wordlwide  Threat 
Assessment  of  the  US  Intelligence  Community,  1 13th  Cong.,  2d  sess.,  2014. 
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Forum,  2014),  9. 
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Figure  1 :  The  interconnections  of  threats  in  the  global  security  environment 
Source:  Global  Risk  Survey  2014:  Ninth  Edition 


Application  of  complexity 

Good  analysis  makes  the  complex  comprehensible,  which  is  not  the  same  as  simple. 

-  Martin  Petersen,  former  senior  CIA  Directorate  of  Intelligence  officer110 

Complexity  science  describes  how  nonlinear,  dynamic  systems  operate  and  offers  insight 
into  the  current  security  environment  and  how  to  improve  warning  analysis.  Mathematician  Dr. 
Warren  Weaver,  in  his  1948  paper  “Science  and  Complexity,”  described  scientific  advancements 
as  the  solving  of  three  types  of  problems.  Scientists  in  the  17th  to  19th  centuries  focused  on  solving 
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the  first  problem  set,  which  Weaver  called  problems  of  simplicity.  These  problems  consist  of  two 
variables  with  close  interactions.  Solving  them,  led  to  the  discovery  of  basic  laws  of  gravity, 
motion,  and  electromagnetism;  along  with  the  technology  that  runs  most  of  the  modem  world,  to 
include  the  lightbulb,  automobiles,  and  airplanes.111  Scientists  then  solved  the  second  problem 
set,  which  Weaver  called  problems  of  disorganized  complexity.  These  problems  consist  of 
millions  or  more  variables  interacting  haphazardly,  such  as  helium  atoms  colliding  in  a  balloon, 
and  are  described  by  statistical  mechanics.  The  solutions  to  these  problems  led  to  the  discovery  of 
the  laws  of  thermodynamics  and  applied  to  improve  efficiency  at  large  telephone  call  centers  and 
in  the  development  of  life  insurance  actuary  tables.  112  For  scientists  in  the  twentieth  and  going 
into  the  twenty-first  century,  Weaver  describes  the  challenge  of  the  third  problem  set,  which  he 
calls  problems  of  organized  complexity.  Weaver  describes  problems  of  organized  complexity  as 
the  middle  ground  where  a  moderate  number  of  variable  are  closely  related  through  their 
interactions.  Furthermore  he  describes  organized  complex  problems  as  “dealing  simultaneously 
with  a  sizable  number  of  factors  which  are  interrelated  into  an  organic  whole.”  113 

In  the  sixty  years  since  Weaver  wrote  his  article,  scientific  attempts  to  answer  his  third 
problem  set  developed  into  a  cutting  edge  and  multi-discipline  field  of  study  called  complexity 
science.  The  field  incorporates  mathematics,  physics,  chemistry,  biology,  economics, 
meteorology,  computer  science,  social  sciences,  philosophy,  art,  and  others.114  The  focus  of  the 
field  is  to  gain  understanding  of  complex  adaptive  systems,  which  scientist  Melanie  Mitchell 
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defines  in  her  book  Complexity:  A  Guided  Tour  as  a  “system  in  which  large  networks  of 
components  with  no  central  control  and  simple  rules  give  rise  to  complex  collective  behavior, 
sophisticated  information  processing,  and  adaptation  via  learning  or  evolution.”115  The  variety 
found  in  complex  systems  is  numerous  and  occur  from  the  micro-cellular  level  to  global 
networks.  Examples  of  complex  systems  include  insect  colonies,  flocks  of  birds,  schools  of  fish, 
the  brain,  the  immune  system,  the  financial  system  and  markets,  cities,  and  the  World  Wide 
Web.116 

Put  more  colloquially,  complex  systems  are  systems  in  which  the  whole  is  greater  than 
the  sum  of  its  parts.  In  contrast,  Spanish  complexity  scientist,  Ricard  Sole,  believes  “the  whole  is 
different  from  the  sum  of  its  parts,”  with  multiple  interactions  creating  new  phenomena  that 
cannot  be  explained  by  the  properties  of  the  individual  isolated  units. 117  The  key  properties  of 
complex  systems,  according  to  Sole,  are  self-organization  and  emergence.  Self-organization  is  a 
bottom-up  phenomena  where  all  individual  units  within  a  system  assume  roles  and  complete  tasks 
based  solely  on  their  interactions  with  their  neighbors  and  their  immediate  environment.  This 
contrasts  with  top-down  systems  where  a  few  individual  units  assign  tasks  and  control  their 
execution  through  a  hierarchy. 118  When  numerous  interactions  of  individual  units  occur  in  a  self- 
organized  system,  new  properties  emerge  that  are  distinct  from  any  characteristics  of  the 
individuals.  The  overall  effects  can  be  very  complex. 119  Ant  colonies,  the  human  brain,  and  flocks 
of  birds  exemplify  emergent  properties  in  self-organizing  systems.  Individual  ants  are 
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unsophisticated  animals.  Research  in  ant  behavior  shows  one  hundred  army  ants  will  walk  in 
circles  until  they  die.  However,  when  ants  are  a  member  of  a  colony  of  several  hundred  thousand 
they  become  part  of  a  self-organized  system. 120  A  colony  of  ants  build  complex  structures,  gather 
food,  defend  the  colony  from  other  ants,  care  for  young,  and  conduct  cleaning  and  maintenance  in 
the  colony.  The  collective  work  of  the  individual  ants  accomplishes  all  of  those  tasks  without  a 
central  authority  prioritizing  work  or  assigning  duties.  Instead,  the  ants  determine  their  tasks 
based  on  the  interaction  of  the  ants  they  come  in  contact.  Additionally,  the  ants  conduct  their 
tasks  with  amazing  efficiency  by  quickly  identifying  the  shortest  path  to  food  sources  and  by 
moving  waste  products  the  optimal  distance  from  the  colony. 121  Similarly,  the  human  brain 
consists  of  100  billion  neurons.  Each  neuron  by  itself  is  relatively  simple  and  limited  to  the 
signals  it  sends  and  receives  from  its  direct  neighbors. 122  However,  as  part  of  the  brain,  the 
neurons  collectively  form  a  system  that  is  the  most  complex  system  known  to  man.123  The 
neurons  combined  create  the  emergent  properties  that  allow  the  brain  to  store  information, 
regulate  and  control  the  body,  process  information,  repair  itself,  dream,  and  create.124  Lastly,  the 
emergence  of  complex  behavior  is  also  the  result  of  simple  rules.  Birds  in  a  flock  create  a 
complex  system  where  their  synchronized  movement  emerges  and  resembles  an  organic  whole. 
Three  simple  rules  are  able  to  describe  the  flock’s  emergent  behavior:  the  birds  need  to  avoid 
collisions  with  nearby  flockmates,  match  the  velocity  and  direction  of  nearby  flockmates,  and 
stay  close  to  nearby  flockmates. 125 
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The  multiple  interactions  and  components  in  a  complex  adaptive  system,  which  give  rise 
to  self-organization  and  emergence,  also  make  the  system  dynamic  and  its  behavior  difficult  to 
predict.  Dynamic  complex  systems  change  as  they  interact  and  adapt  to  their  environment 
through  a  system  of  feedback  loops,  meaning  the  current  condition  of  the  system  will  affect  its 
future  behavior. 126  Positive  feedback  promotes  change  while  negative  feedback  works  to  maintain 
equilibrium.  The  key  aspect  to  the  change  in  complex  systems  is  that  change  is  nonlinear, 
meaning  it  consists  of  exponential  relationships  and  generally  cannot  be  solved. 127  Author  James 
Gleick  describes  nonlinear  systems  as  walking  in  a  maze  in  which  the  walls  rearrange  themselves 
with  each  step. 128  As  a  result,  the  dynamics  of  complex  adaptive  systems  make  their  behavior 
difficult  to  precisely  predict  and  small  changes  can  create  large  changes. 129  The  following  nursery 
rhyme  highlights  the  nonlinear  and  dynamic  properties  of  complex  systems: 

For  Want  of  a  Nail 

For  want  of  a  nail,  the  shoe  was  lost. 

For  want  of  a  shoe,  the  horse  was  lost. 

For  want  of  a  horse,  the  rider  was  lost. 

For  want  of  a  rider,  the  message  was  lost. 

For  want  of  a  message,  the  battle  was  lost. 

For  want  of  a  battle,  the  kingdom  was  lost. 

And  all  for  the  want  of  a  horseshoe  nail.130 
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The  output  of  one  stage  becomes  the  input  for  the  next  and  the  loss  of  one  nail  permeated 
exponentially  and  unpredictably  through  the  system  resulting  in  the  loss  of  the  kingdom. 

The  nonlinear  dynamics  make  complex  systems  chaotic  and  provides  further  challenges 
in  attempting  to  predict  their  behavior.  Chaotic  systems  have  “sensitive  dependence  on  initial 
conditions.”131  In  the  words  of  nineteenth  century  French  mathematician  Henri  Poincare  “small 
differences  in  the  initial  conditions  produce  very  great  ones  in  the  final  phenomenon.  A  small 
error  in  the  former  will  produce  an  enormous  error  in  the  latter.”132  Meteorologist  and 
mathematician  Edward  Lorenz  discovered  the  phenomena  of  sensitive  dependency  in  1 963  when 
he  found  small  variations  in  the  input  of  his  deterministic  weather  modeling  program  created  vast 
changes  in  outcomes.133  His  discovery  commonly  referred  to  as  the  Butterfly  Effect  -  a  butterfly 
flaps  its  wings  in  Brazil  and  the  small  variations  create  a  tornado  in  Texas  -  highlights  how  even 
deterministic  systems  have  predictability  limits.134  Since  all  measurements  are  approximations, 
the  differences  in  tenth,  hundredth,  thousandths,  and  more  of  a  decimal  point  have  the  ability  to 
create  large  changes  to  the  final  output  in  a  complex  system.  The  result,  again,  in  the  description 
of  Poincare,  “Predictions  become  impossible.”135 

A  simple  example  highlighting  how  small  differences  in  initial  conditions  produce  large 
difference  in  the  final  outcome  is  iterative  doubling.  Iterative  doubling  is  simply  function  in 
which  the  initial  input  is  doubled,  and  the  output  becomes  the  input  for  the  next  doubling.  Figure 
2  shows  how  the  initial  change  of  five  tenths  and  one  tenth  can  quickly  result  in  orders  of 
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magnitude  difference  in  output.  The  divergence  begins  after  six  steps  and  by  step  twelve  there  is 
a  ten  percent  difference  between  an  initial  starting  point  of  1.0  and  1.1.  In  a  more  complex 
system,  the  divergence  develops  from  even  smaller  differences  in  inputs  and  permeates  through 
multiple  iterations. 


Figure  2:  Iterative  doubling  series  shows  how  small  changes  in  initial  conditions  quickly  results 
in  divergent  outcomes 
Source:  Created  by  author 

However,  the  nonlinear  interactions  of  complex  systems  and  lack  of  predictability  does 
not  mean  randomness  or  disorder.136  The  multiple  connections  made  by  the  components  of 
complex  systems  form  networks.  Dr.  Ricard  Sole  argues  in  his  2008  paper,  “On  Networks  and 
Monsters:  The  Possible  and  the  Actual  in  Complex  Systems,”  that  networks  are  a  unifying  theme 
of  complex  systems  and  “pervade  complexity  at  multiple  scales.”137  From  natural  to  man-made 
complex  systems,  networks  create  a  common  structural  framework  that  result  in  order  and 
organizing  principles. 138  British  Complexity  scientist,  Dr.  John  Gribbin,  describes  how  the 
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network  is  a  fundamental  component  of  complexity  stating,  “Having  stripped  the  study  of 
complexity  down  to  its  bare  essentials. . .  we  discover  that  it  is  all  built  on  networks, 
interconnections  between  the  simple  parts  that  make  up  a  complex  system.”139  Figures  3,  4,  and  5 
demonstrate,  the  greater  the  complexity  of  the  system,  the  more  developed  the  structure.  The 
arrangement  of  atoms  within  proteins,  the  relationship  between  words  in  a  book,  and  the  Internet 
all  create  networks  of  similar  structures.  This  networked  structure  can  be  used  to  identify  how  to 
manipulate  the  interactions  to  change  the  environment. 140  Additionally,  chaotic  systems,  despite 
their  inability  to  predict  detailed  behavior,  also  form  order  that  allows  for  system  level 
predictability. 141 


Figure  3:  Protein  shows  the  network  structure  between  atoms 

Source:  Ricard  Sole,  “On  Networks  and  Monsters:  The  Possible  and  Actual  in  Complex  Systems” 
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Figure  4:  Language  web:  word-word  interactions  from  the  first  chapter  of  Moby  Dick 

Source:  Ricard  Sole,  “On  Networks  and  Monsters:  The  Possible  and  Actual  in  Complex  Systems” 


Figure  5:  The  internet  in  2010 

Source:  http://www.opte.org/,  accessed  February  14,  2015. 

Complexity  science  is  the  study  of  complex  adaptive  systems  from  multiple  disciplines. 
Complex  adaptive  systems  consist  of  relatively  simple,  interconnected  base  units,  allowing  them 
to  self-organize  and  create  emergent  properties  that  are  distinct  and  more  complex  than  the 
individual  units.  Complex  systems  are  also  nonlinear  and  difficult  to  use  in  predicting  future 
behavior  due  to  small  variations  propagating  through  the  system  and  the  inability  to  precisely 
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measure  initial  conditions.  However,  complex  systems  also  create  order  and  structures  that  allow 
for  analysis  in  the  form  of  networks,  periodic  doubling,  fractals,  and  the  ability  to  manipulate  the 
system. 

Application  1:  Complexity  applied  to  the  structure 

The  number  of  threats  and  the  speed  in  which  they  operate  are  increasing  and  places 
greater  demands  on  the  Intelligence  Community.  Amy  Zegart  wrote,  “National  Security  in  a  post- 
97 1 1  world  hinges  more  on  what  we  can  learn  than  what  we  can  destroy  -  understanding 
adversaries’  intentions,  capabilities,  preferences,  fears,  and  weaknesses  faster  and  better  than  they 
can  understand  ours.”142  Zegart’s  concept  closely  matches  retired  General  Stanley  McChrystal’s 
revelation  “In  bitter,  bloody  fights  in  both  Afghanistan  and  Iraq,  it  became  clear  to  me  and  to 
many  others  that  to  defeat  a  networked  enemy  we  had  to  become  a  network  ourselves.  We  had  to 
figure  out  a  way  to  retain  our  traditional  capabilities  of  professionalism,  technology,  and,  when 
needed,  overwhelming  force,  while  achieving  levels  of  knowledge,  speed,  precision,  and  unity  of 
effort  that  only  a  network  could  provide.” 143  From  a  business  viewpoint,  Peter  M.  Singe,  an 
American  systems  scientist  and  a  Massachusetts  Institute  of  Technology  lecturer,  offers  a  similar 
perspective,  stating,  “As  the  world  becomes  more  interconnected  and  business  becomes  more 
complex  and  dynamic,  work  must  becoming  more  ‘leamingful’.”144  The  Intelligence  Community 
can  apply  the  concepts  of  complex  adaptive  systems  to  further  reform  its  structure  and  improve 


142 Amy  B.  Zegart,  “Let  the  C.l.A.  Do  What  it  is  Suppose  to  Do',”  New  York  Times, 
December  22,  2014,  accessed  February  11,  2015, 

http://www.nytimes.com/roomfordebate/2014/12/21/do-we-need-the-cia/let-the-cia-do-what-it-is- 

suppose-to-do. 

143Stanley  A.  McChrystal,  “It  Takes  a  Network:  The  New  Front  Line  of  Modem 
Warfare,”  Foreign  Policy  (February  21,  201 1):  1,  accessed  February  1 1,  2015, 
http://foreignpolicy.com/20 1 1/02/2  l/it-takes-a-network/?wp_login_redirect=0. 

144Peter  M.  Senge,  The  Fifth  Discipline:  the  Art  and  Practice  of  the  Learning 
Organization,  rev.  ed.  (New  York:  Doubleday,  2006),  4. 
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the  warning  process  by  allowing  itself  to  quickly  adapt  to  changing  demands  through  self¬ 
organization  and  emergence. 

The  notion  of  a  complex  adaptive  Intelligence  Community  is  not  a  new  one.  Jeffrey  R. 
Cooper  wrote  in  his  2005  article,  “Curing  Analytic  Pathologies:  Pathways  to  Improved 
Intelligence  Analysis”  how  “the  Intelligence  Community  is  an  exemplar,  even  if  not  a  healthy 
one,  of  a  truly  complex  adaptive  system.”145  The  unhealthy  aspects  within  the  Intelligence 
Community,  Cooper  argues,  are  the  result  of  a  lack  of  self-reflection,  insular  security  barriers,  and 
bureaucratic  self-protection  signals.146  In  the  terms  of  complexity  science,  these  tendencies 
produce  negative  feedback  that  suppress  the  external  pressures  to  change  to  the  new  environment. 
Additionally,  Dr.  D.  Calvin  Andrus,  an  intelligence  officer  in  the  CIA’s  Directorate  of  Support, 
addressed  the  Intelligence  Community’s  need  to  better  adapt  to  the  changing  environment  in  his 
2007  article  “Toward  a  Complex  Adaptive  Intelligence  Community:  The  Wiki  and  the  Blog.”147 
In  the  article,  Andrus  contends,  “The  only  way  to  meet  the  continuously  unpredictable  challenges 
ahead  of  us  is  to  match  them  with  continuously  unpredictable  changes  of  our  own.  We  must 
transform  the  Intelligence  Community  into  a  community  that  dynamically  reinvents  itself  by 
consciously  learning  and  adapting  as  the  national  security  environment  changes.”148 

Andrus’  proposed  recommendations  for  making  the  Intelligence  Community  a  complex 
adaptive  system  integrate  the  use  of  information  and  social  media  technology  with  the  analytic 
process  to  increase  the  links  between  analysts.  This  will  allow  for  greater  self-organization  and 


145Jeffrey  R.  Cooper,  Curing  Analytic  Pathologies:  Pathways  to  Improved  Intelligence 
Analysis  (Washington,  DC:  Center  for  the  Studies  of  Intelligence,  2005):  9. 


146lbid. 


147D.  Calvin  Andrus,  “Toward  a  Complex  Adaptive  Intelligence  Community:  The  Wiki 
and  the  Blog”,  Studies  in  Intelligence  49,  no.  3  (April  15,  2007). 
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improved  internal  feedback.149  The  Intelligence  Community  incorporated  several  of  Andrus’ 
ideas  including  blogs,  wiki,  social  networking,  communities  of  interests,  and  other  collaboration 
tools.150  Of  particular  note  is  Intellipedia,  an  Intelligence  Community  version  of  Wikipedia  that 
allows  collaborative  editing  of  its  content  and  structure  that  resides  on  both  classified  and 
unclassified  networks.151  Additionally,  the  Intelligence  Community  developed  a  Library  of 
National  Intelligence  to  increase  access  to  finished  intelligence  products  across  the  IC  for 
increased  collaboration.152  The  Intelligence  Community  Information  Technology  Enterprise  (IC 
ITE)  strategy  is  also  moving  forward  with  greater  integration  of  information  systems  and  cloud 
computing  in  order  to  provide  a  shared  environment:  thus  further  interconnecting  the 
community. 153  Collectively,  these  reforms  are  the  cornerstone  for  “Intelligence  Community 
Directive  501 :  Discovery  and  Dissemination  or  Retrieval  of  Information  within  the  Intelligence 
Community”  which  is  meant  to  “Provide  an  improved  capacity  to  warn  of  and  disrupt  threats  to 
the  United  States  (U.S.)  homeland,  and  U.S.  persons  and  interests.”154 

Subsequently,  these  reforms,  as  described  by  former  senior  DIA  intelligence  officer,  the 
first  Deputy  Director  of  National  Intelligence  for  Intelligence  Integration,  and  current  National 
Geospatial-Intelligence  Agency  director  Robert  Cardillo,  have  created  a  new  emergent  culture 

149Ibid. 

150Ibid.;  Massimo  Calabresi,  “Wikipedia  for  Spies:  The  CIA  Discovers  Web  2.0,”  Time, 
April  8,  2009,  1,  accessed  February  1 1,  2015, 

http://content.time.eom/time/nation/article/0, 8599, 1890084, 00. html.;  Cardillo,  7. 

151Robert  Hink,  “Intellipedia,”  Center  for  Strategic  &  International  Studies,  accessed 
February  11,  2015,  http://csis.org/blog/intellipedia. 

152Cardillo,  4. 

1530ffice  of  the  Director  of  National  Intelligence,  “Chief  Information  Officer:  What  We 
Do,”  Office  of  the  Director  of  National  Intelligence,  accessed  February  1 1,  2015, 
http://www.dni.gov/index.php/about/organization/chief-infomiation-officer-what-we-do. 

154John  Michael  Mitchell,  Intelligence  Community  Directive  Number  501:  Discovery  and 
Dissemination  or  Retrieval  of  Information  Within  the  Intelligence  Community  (Washington,  DC: 
Office  of  the  Director  of  National  Intelligence,  January  21,  2009). 
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within  the  Intelligence  Community.  Cardillo  recognizes  the  transition  to  the  new  technologies  has 
been  largely  driven  by  younger  intelligence  officers  who  are  more  comfortable  with  social 
media.155  However,  despite  an  uneven  start,  programs  like  Intellipedia  produced  results.  For 
example,  Tom  Fingar,  who  headed  the  National  Intelligence  Council  from  2005  to  2008, 
described  how  an  Intellipedia  request,  for  collecting  evidence  on  the  first  use  of  chlorine  in 
improvised  explosive  device  in  Iraq,  resulted  in  the  development  of  serviceable  set  of  instructions 
in  48  hours.  The  request  drew  responses  of  twenty-three  people,  from  nearly  twenty  locations 
around  the  world.156 

Despite  identified  successes  and  progress  made,  the  Intelligence  Community  remains  a 
relatively  closed  system  due  to  security  requirements  and  similarities  in  analytic  tradecraft.  The 
effect  is  a  significant  reduction  in  the  value  of  the  network  created  within  the  Intelligence 
Community  and  the  information  it  can  process.  According  to  Metcalfe’s  Law  (see  Figure  6)  a 
maxim  developed  by  Robert  Metcalfe  -  the  founder  of  3Com  and  inventor  of  the  Ethernet 
protocol,  "The  value  of  a  network  increases  exponentially  with  the  number  of  nodes."157 
Furthermore,  “Reed’s  Law”,  developed  by  computer  scientist  David  P.  Reed  contends  that 
expanding  the  number  of  nodes  in  a  system  is  even  more  powerful  than  Metcalfe  realized.  Instead 
of  just  focusing  on  the  individual  nodes,  the  people  in  the  network  are  able  to  form  sub-groups 
that  also  interact  creating  even  more  ability  to  collaborate  and  share.  158 


155Robert  Cardillo,  “Intelligence  Community  Reform:  A  Cultural  Evolution,”  Studies  in 
Intelligence  54,  no.  3  (September  2013):  1-7. 

156Massimo  Calabresi,  “Wikipedia  for  Spies:  The  CIA  Discovers  Web  2.0,”  Time,  April 
8,  2009,  1,  accessed  February  1 1,  2015, 

http://content.time.eom/time/nation/article/0, 8599, 1890084, 00.  html. 

157“Encyclopedia:  Definition  of  Metcalfe's  Law,”  PCMag.com,  accessed  February  11, 
2015,  http://www.pcmag.com/encyclopedia/term/46867/metcalfe-s-law. 

158“Encyclopedia:  Definition  of  Reed’s  Law,”  PCMag.com,  accessed  February  11,  2015, 
http  ://www.pcmag.  com/encyclopedia/term/ 642 1 7/reed-s-law. 


40 


Q - Q  — ► 


7igure  6:  Metcalfe’s  Law  -  The  Network  Effect  for  Telecommunication  Networks 

Source:  http://www.mkbergman.com/1788/the-value-of-connecting-things-part-i-a-foundation- 

based-on-the-network-effect/,  accessed  February  14,  2015. 

Additionally,  when  attempting  to  develop  understanding  of  complex  systems  it  is 
necessary  to  have  cross-discipline  collaboration.  Dr.  Warren  Weaver  described  the  success  the 
British  and  Americans  had  during  World  War  11  through  their  use  of  teams  called  operational 
analysis  groups.  The  most  successful  of  these  groups  did  not  consist  solely  of  mathematicians, 
physicists,  and  engineers,  but  also  physiologist,  biochemists,  psychologists,  and  other 
representatives  from  biochemical  and  social  sciences.  Weaver  stated,  “It  was  found,  in  spite  of 
the  modem  tendencies  toward  intense  scientific  specialization,  that  members  of  such  diverse 
groups  could  work  together  and  could  form  a  unit  which  was  much  greater  than  the  mere  sum  of 
their  parts.  It  was  shown  these  groups  could  tackle  certain  problems  of  organized  complexity,  and 
get  useful  answers”159 

A  University  of  Pennsylvania  research  team  found  the  same  principle,  as  observed  by  Dr. 
Weaver,  can  also  be  applied  to  predicting  geopolitical  events.  The  research  team,  while 
participating  in  an  Intelligence  Advanced  Research  Projects  Activity  (1ARPA)  forecasting 
tournament,  found  the  predictions  made  by  people  working  in  groups  were  ten  percent  more 
accurate  than  predictions  made  by  individuals.  Furthermore,  working  in  a  team  increased  open 
mindedness  due  to  the  opportunity  for  dissent  to  arise  and  expanded  the  diversity  of  knowledge 


159 Weaver,  536-544. 
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within  the  team.160  Additionally,  the  team  findings  showed  that  non-subject  matter  experts  can  be 
trained  to  be  effective  forecasters,  even  without  access  to  classified  reporting. 161  That  team 
members  were  able  to  share  information  and  discuss  their  various  justifications,  yet  still  submit 
their  forecasts  anonymously,  supports  other  studies  that  aggregating  judgments  or  predictions 
across  individuals  can  be  surprisingly  accurate  in  a  variety  of  domains  -  to  include  prediction 
markets,  political  polls,  game  shows,  and  forecasting162  These  conclusions  support  Carmen 
Medina’s,  Director  for  the  CIA’s  Center  for  the  Study  of  Intelligence,  identified  trends  that,  “the 
traditional  model  of  the  individual  analyst  at  the  center  of  the  intelligence  process  is  receding. 
Expertise  will  matter  more  in  terms  of  how  it  describes  the  complete  expertise  of  a  collaborative 
group.  Expertise  in  collaboration  will  become  more  important.  . . .  there  would  also  be  increased 
demand  for  collaborative  communities  of  analysts  that  can  bring  greater  mental  resources  to  bear 
on  a  problem.”163 

Application  2:  Complexity  applied  to  the  analyst 

CIA  veteran  Richard  J.  Heuer,  Jr.  stated,  “When  we  speak  of  improving  intelligence 
analysis,  we  are  usually  referring  to  the  quality  of  writing,  types  of  analytical  products,  relations 
between  intelligence  analysts  and  intelligence  consumers,  or  organization  of  the  analytic  process. 


'“Barbara  Mellers  et  al.,  “The  Psychology  of  Intelligence  Analysis:  Drivers  of  Prediction 
Accuracy  in  World  Politics,”  advanced  online  issue,  Journal  of  Experimental  Psychology’: 
Applied  (January  12,  2015):  1,  accessed  February  11,  2015, 
http://www.apa.org/pubs/joumals/releases/xap-0000040.pdf. 

161American  Psychological  Association,  “Teams  Better  Than  Individuals  at  Intelligence 
Analysis,  Research  Finds,”  Press  Releases,  January  13,  2015,  accessed  February  1 1,  2015, 
http://www.apa.org/news/press/releases/2015/01/intelligence-analysis.aspx. 

162lbid.;  Clintin  P.  Davis-Stober  et  ah,  “When  Is  a  Crowd  Wise?,”  Decision  1,  no.  2 
(April  2014):  79-101. 

163Center  for  Security  Studies,  “ Emerging  Threats  in  the  21st  Century  ”  -  Strategic 
Foresight  and  Warning  Seminar  Series  (Zurich:  Center  for  Security  Studies,  2007),  12. 
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Little  attention  is  devoted  to  improving  how  analysts  think.”164  Within  the  descriptor  “how 


analysts  think”  should  include  “how  analysts  understand  the  current  security  environment.” 
Analysts  can  use  complexity  science  principles  of  non-linearity,  self-organization,  emergence, 
and  chaos  to  improve  their  understanding  of  the  security  environment  and  the  nature  of  emerging 
threats  to  provide  warnings  earlier  and  with  greater  detail. 

Former  NIO-W  Kenneth  Knight  described  why  analysts  delay  in  delivering  warning 
forecasts  stating,  “Too  often. . .  our  analysts  try  to  make  an  either-or  call.  So,  you  know,  leader  A 
is  going  to  be  removed  from  power  or  he’s  not.  And  again,  since  nobody  wants  to  be  wrong, 
when  you’re  down  to  that  either-or  approach  1  think  you  are  waiting  until  the  confirming 
evidence  is  overwhelming.”165  However,  complexity  science  describes  how,  due  to  the  sensitivity 
of  initial  conditions;  interdependence;  and  nonlinearity,  precise  predictions  are  impossible. 
Analyst  pressured  not  to  make  mistakes,  don’t  want  to  make  mistakes.  Complexity  science  gives 
analysts  the  ability  to  understand  prediction  is  not  possible  due  to  sensitivity  in  initial  conditions 
and  nonlinearity  within  the  network. 

Many  of  the  emerging  threats  to  American  national  interests  are  social  phenomena  that 
result  in  a  change  in  government,  the  rise  of  non-state  actors,  or  an  intervention  by  another 
country.  The  Intelligence  Community’s  failure  to  warn  policy  makers  of  the  1979  fall  of  the  Shah 
in  Iran,  the  1994  end  of  apartheid  in  South  Africa,  the  2010  Arab  Awakening,  and  the  2014  Kiev 
protests  and  Russian  annexation  of  Crimea  show  a  pattern  of  not  understanding  self-organizing 
patterns  and  emergent  behaviors.  Ms.  Irene  Sanders,  the  executive  director  of  the  Washington 
Center  for  Complexity  and  Public  Policy,  described  how  the  CIA  did  not  see  the  end  of  apartheid 
because  they  focused  on  what  the  South  African  leaders  were  saying  and  rather  than  paying 


164Heuer,  1-2. 

165McKinsey&Company  (video). 
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attention  to  what  was  going  on  in  the  streets  and  the  neighborhoods  across  the  country.166  Nearly 
twenty  years  later,  former  D1A  Deputy  Director,  Mr.  Shedd,  described  how  the  Intelligence 
Community  similarly  missed  the  subtleties  in  the  populations  living  in  the  countries  affected  by 
the  Arab  Spring.  He  stated  how  those  bottom-up  indicators  would  have  “shown  us,  that  there  was 
a  growing  dissatisfaction  and  then  at  the  same  time  the  conditions  to  address  that  dissatisfaction 
in  the  general  population.”  Again,  a  reason  for  the  gap,  Shedd  added,  was  collection  of 
information  by  the  Intelligence  Community  from  those  in  power  in  the  region  and  not  from 
opposition  groups. 167 

Nassim  Taleb,  in  his  book  The  Black  Swan:  The  Impact  of  the  Highly  Improbable,  calls 
events  that  are  only  predictable  after  the  fact  and  carry  extreme  impacts  Black  Swans.168  Kristan 
J.  Wheaton,  an  associate  professor  of  Intelligence  Studies  at  the  Tom  Ridge  School  of 
Intelligence  Studies  and  Information  Science,  argues  that  while  Black  Swans  are  by  their  nature 
unpredictable  and,  they  are  the  cumulative  result  of  events  building  over  time.  He  asserts,  if 
analysts  shift  focus  to  the  links  between  events  and  not  just  the  events  themselves  they  would  be 
able  to  identify  patterns.  These  patterns  may  follow  power  law  distributions  and  will  not  allow  for 
predicting  a  specific  occurrence,  does  allow  for  the  ability  to  forecast  the  likelihood  an  event  will 
take  place.  169 


166Wilson  Center  (video). 

167Cheryl  Pellerin,  “D1A  Five-Year  Plan  Updates  Strategic  Warning  Mission,”  DoD 
News,  July  18,  2012,  accessed  February  11,  2015, 
http://www.defense.gov/news/newsartiele.aspx?id=  117160. 

168Nassim  Nicholas  Taleb,  The  Black  Swan:  the  Impact  of  the  Highly  Improbable,  2nd  ed. 
(New  York:  Random  House  Trade  Paperbacks,  2007),  1. 

169  Kristan  J.  Wheaton,  “How  to  Analyze  Black  Swans,”  Sources  and  Methods  (blog), 
April  21,  2014,  accessed  February  1 1,  2015, 
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Lastly,  complex  systems  can  shape  how  analysts  understand  cause  and  effect  in  nonlinear 
systems,  with  lags  in  time  and  location.  In  classic  forecasting  models,  the  future  is  merely  an 
extension  of  existing  conditions,  trends,  and  models  are  based  on  deterministic  cause-and-effect 
beliefs. 170  However,  due  to  the  greater  interconnectedness  in  global  transportation  and 
communication  systems,  events  in  one  part  of  the  world  can  trigger  the  emergence  of  threats  in 
distant  locations.  President  Carter’s  National  Security  Advisor,  Zbigniew  Brzezinski,  described 
this  effect  in  the  global  environment  saying,  “We  are  facing  a  kind  of  dynamically  spreading 
chaos  in  parts  of  the  world.  Now  in  the  Middle  East,  but  that  could  spread  to  other  portions  of 
West  Asia,  to  Central  Asia,  even  into  Russia,  perhaps  even  to  China.”171 

Application  3:  Complexity  applied  to  the  policymaker 

The  challenge  remains  how  to  describe  complex  systems  to  decision  makers.  Jerry 
Sabloff,  President  of  Sante  Fe  Institute  stated  “Policy  makers  and  people  in  Congress,  in  city  hall, 
etc. . .  still  don’t  understand  complex  systems  because  they  still  think  ‘if  1  do  A 1  will  get  result  B, 
and  then  are  always  surprised  when  they  get  result  C,  D”172  Additionally,  when  briefers  sketched 
the  complexity  of  the  Afghanistan  operational  environment  (see  Figure  7)  to  then  commander  of 
US  and  International  Security  Assistance  Force  in  Afghanistan,  General  Stanley  McChrystal,  he 
jokingly  stated  “When  we  understand  that  slide,  we’ll  have  won  the  war.”173  The  briefing  slide 

170Wilson  Center  (video). 

171Benjamin  Fandy,  “Zbigniew  Brzezinski  On  Isis,  Ukraine,  and  the  Future  of  American 
Power,”  MSNBC ,  September  10,  2014,  accessed  February  1 1,  2015, 

http://www.msnbc.com/msnbc/zbigniew43rzezinski-isis-ukraine-and-the-future-american-power. 

172Santa  Fe  Institute,  “Complexity:  Fife,  Scale,”  (video),  August  29,  2012,  accessed 
February  1 1,  2015, 

https://www.youtube.com/watch?v=0yF8j37S10w&list=PFC_Rf_NXNwOlbCS_7UtDXEITlwP 

b-8pw;. 

173Elisabeth  Bumiler,  “We  Have  Met  the  Enemy  and  He  Is  Powerpoint,”  New  York 
Times,  April  26,  2010,  accessed  February  1 1,  2015, 
http://www.nytimes.com/20 10/04/27/world/27powerpoint.html?_r=0. 
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also  created  concerns,  as  presenting  the  complex  nature  of  the  environment  raised  doubts  on  the 
ability  to  make  progress  in  Afghanistan. 


Afghanistan  Stability  /  COIN  Dynamics 
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Figure  7:  “Afghanistan  Stability  /  Counter  Insurgency  Dynamics”  graphic 

Source:  http://www.nytimes.com/2010/04/27/world/27powerpoint.html7_F0,  accessed  February 

14,2015. 


When  people  face  an  increasingly  complex  environment,  they  rely  predominately  on 
experience  and  intuition  in  decision-making. 174  Dr.  Alex  Bennet,  former  Chief  Information 
Officer  for  the  Department  of  the  Navy  Enterprise  Integration,  and  David  Bennet,  consultant  to 
support  sustained  growth  and  decision  making  in  complex  environments,  argue  that  logic-based 
decision-making  in  complex  adaptive  systems  arises  from  framework  building  based  on  the 


174Erik  J.  Dahl,  Intelligence  and  Surprise  Attack:  Failure  and  Success  from  Pearl  Harbor 
to  9/1 1  and  Beyond  (Washington,  DC:  Georgetown  University  Press,  2013),  xv;  Alex  Bennet  and 
David  Bennet,  “The  Decision-Making  Process  for  Complex  Situations  in  a  Complex 
Environment,”  in  Handbook  On  Decision  Support  Systems,  ed.  F.  Burstein  and  C.  W.  Holsapple 
(New  York:  Springer- Verlag,  2008). 
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concepts  of  complexity  to  include  emergence,  butterfly  effect,  tipping  point,  feedback  loops,  and 
power  laws.175  Furthermore,  Marketing  Professor,  J.  Edward  Russo,  and  pioneer  in  decision 
sciences,  Paul  J.H.  Schoemaker,  identify  the  importance  of  developing  the  proper  framework  as 
the  necessary  first  step  to  decision-making. 176  Additionally,  German  theoretical  psychologist 
Dietrich  Domer,  in  his  book  The  Logic  of  Failure:  Recognizing  and  Avoiding  Error  in  Complex 
Situations  states,  “Formless  collections  of  data  about  random  aspects  of  a  situation  merely  add  to 
the  situation’s  impenetrability  and  are  no  aid  to  decision  making.”  177  Rather  the  information 
needs  to  be  arranged  into  a  cohesive  picture  that  models  the  reality  of  the  system  to  give  the 
information  meaning  and  allow  the  user  to  find  order  in  apparent  chaos. 178 

“Intelligence  Community  Directive  203:  Analytic  Standards”  established  the  standard 
requirements  for  all  Intelligence  Community  analytic  products.  These  requirements  include  the 
five  analytic  standards:  objective  analysis,  independent  of  political  considerations,  timely,  based 
on  all  available  sources  of  intelligence  information,  and  implements  and  exhibits  Analytic 
Tradecraft  Standards.  179  In  addition  to  these  standards,  analysts  should  incorporate  descriptions 
of  the  complexity  of  the  environment  to  support  greater  logic-based  decision  making. 
Furthermore,  a  policymaker’s  level  of  familiarity  with  complexity  principles  will  shape  how  they 
face  complex  environments  and  will  require  tailored  intelligence  products.  Domer  also  described 
how  complexity  is  a  subjective  experience.  Through  their  individual  experiences,  people  become 


175lbid. 

176J.  Edward  Russo  and  Paul  J.H.  Schoemaker,  Decision  Traps:  Ten  Barriers  to  Brilliant 
Decision-Making  and  How  to  Overcome  Them  (New  York:  Fireside,  1990),  15. 

177Domer,  44-45. 

178lbid. 

179James  Clapper,  Intelligence  Community  Directive  Number  203:  Analytic  Standards 
(Washington,  DC:  Office  of  the  Director  of  National  Intelligence,  January  2,  2015). 
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able  to  group  multiple  variables  together  to  form  “supersignals.”180  “Complexity  must  be 
understood  in  terms  of  a  specific  individual  and  his  or  her  supply  of  supersignals.”181  It  is 
incumbent  for  the  analyst  to  shape  intelligence  products  to  the  policymakers’  specific 
“supersignals”  to  allow  for  quicker  understanding  of  threats  and  greater  likelihood  to  take  action. 


Beware  the  ides  of  March 


Conclusion 


-  William  Shakespeare,  Julius  Caesar 


In  an  age  of  increasing  complexity  and  a  corresponding  expansion  of  threats  to  American 
interests,  the  demand  for  the  Intelligence  Community  to  provide  senior  leaders  with  adequate 
warning  also  increases.  As  a  result,  the  traditional  understanding  of  the  system  and  fixes  to  the 
intelligence  structure,  analytic  tradecraft,  and  communication  to  policymakers  is  no  longer 
adequate.  Amy  Zegart  stated,  “dramatic  improvements  in  the  U.S.  intelligence  capabilities  require 
changing  organizational  routines  and  cultures  as  well  as  structures.”182  According  to  Robert 
Cardillo,  a  cultural  change  is  taking  place  in  information  sharing  and  analytic  quality  due  to  the 
creation  of  the  Office  of  the  Director  of  National  Intelligence  and  lessons  learned  following  the 
September  11,  2001  terrorist  attacks.183  However,  according  to  Kenneth  Knight,  the  incoiporation 
of  modeling  complex  systems  and  large  data  problems  continues  to  lag  due  to  “a  bias  that  says 
this  stuff  is  too  complex  to  model.”184  While  not  a  silver  bullet  to  the  warning  problem,  the 

1S0Domer,  39. 

181Domer,  39. 

182Zegart,  “September  1 1  and  the  Adaptation  Failure  of  the  U.S.  Intelligence  Agencies,” 

80. 

183Cardillo,  1-7. 

184Jay  Ulfelder,  “How  Makers  of  Foreign  Policy  Use  Statistical  Forecasts:  They  Don't, 
Really,”  Dart-Throwing  Chimp  (blog),  June  8,  2012,  accessed  February  11,  2015, 
https://dartthrowingchimp.wordpress.com/tag/ken-knight/. 
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application  of  complexity  theory  principles  offers  a  framework  to  encourage  the  Intelligence 
Community  to  adapt  in  the  new  environment. 

Applying  complexity  science  principles  to  both  the  Intelligence  Community  and  warning 
intelligence  will  also  have  broader  cultural  implications.  The  Intelligence  Community  needs  to 
review  the  requirement  for  all  analysts  to  have  a  clearance  and  incoiporate  more  unclassified 
open  source  information.  By  doing  so  the  Intelligence  Community  can  increase  the  size  of  its 
network  and  incorporate  greater  external  expertise  and  differing  points  of  view.  Additionally,  the 
need  to  monitor  “bottom-up”  emergent  behavior  will  require  a  change  in  technical  and  human 
intelligence  collection  focus  and  clear  policies  balancing  collection  requirements  and  civil-liberty 
protections  at  home  and  abroad.  Lastly,  complexity  concepts  will  require  more  dynamic  finished 
intelligence  and  intelligence  cycle;  with  greater  interaction  between  analyst,  collectors,  and 
policymakers. 
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Appendix  A:  The  United  States  Intelligence  Community 

The  United  States  Intelligence  Community  is  a  coalition  of  17  agencies  within  the 
Executive  Branch  that  work  independently  and  collaboratively  to  gather  and  analyze  intelligence 
necessary  to  conduct  foreign  relations  and  national  security  activities.185  17  members  of  the 
Intelligence  Community  include: 

Central  Intelligence  Agency 

Department  of  Energy 

Department  of  Homeland  Security 

Department  of  State 

Department  of  Treasury 

Defense  Intelligence  Agency 

Drug  Enforcement  Administration 

Federal  Bureau  of  Investigation 

National  Geospatial  Intelligence  Agency 

National  Reconnaissance  Office 

National  Security  Agency 

Office  of  the  Director  of  National  Intelligence 

Air  Force  Intelligence 

Aimy  Intelligence 

Coast  Guard  Intelligence 

Marine  Corps  Intelligence  Activity 

Naval  Intelligence 


1850ffice  of  the  Director  of  National  Intelligence,  “Intelligence  Community,”  Director  of 
National  Intelligence,  accessed  February  1 1,  2015,  http://www.dni.gov/index.php. 
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Appendix  B:  The  Intelligence  Cycle 


The  Intelligence  Cycle  is  the  process  of  developing  raw  information  into  finished  intelligence  for 
use  by  policymakers,  military  commanders,  and  other  consumers  in  decision  making.  This  six- 
step  cyclical  process  is  highly  dynamic,  continuous,  and  never-ending.  The  sixth  step,  evaluation 
(which  includes  soliciting  feedback  from  users)  is  conducted  for  each  of  the  other  five  steps 
individually  and  for  the  Intelligence  Cycle  as  a  whole.  The  six  steps  that  constitute  the 
Intelligence  Cycle  are  as  follows: 186 

Planning  and  Direction:  Establish  the  consumer’s  intelligence  requirements  and  plan  intelligence 
activities  accordingly 

Collection:  Gather  the  raw  data  required  to  produce  the  finished  product. 

Processing  and  Exploitation:  Convert  the  raw  data  into  a  comprehensible  format  that  is  usable  for 
production  of  the  finished  product. 

Analysis  and  Production:  Integrate,  evaluate,  analyze,  and  prepare  the  processed  information  for 
inclusion  in  the  finished  product. 

Dissemination:  Deliver  the  finished  product  to  the  consumer  that  requested  it  and  to  others  as 
applicable. 

Evaluation:  Continually  acquire  feedback  during  the  Intelligence  Cycle  and  evaluate  that 
feedback  to  refine  each  individual  step  and  the  cycle  as  a  whole. 


_ _ _ 


figure  8:  The  Intelligence  Cycle 

Source:  http://www.fas.org/irp/cia/product/facttelkintcycle.htm,  accessed  February  14,  2015. 


186Director  of  National  Intelligence,  U.S.  National  Intelligence:  An  Oven’iew  2011 
(Washington,  DC:  Office  of  the  Director  of  National  Intelligence,  2011),  10-12. 
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